In today’s blog post, we dive into the cutting-edge world of AI research, exploring topics such as the effectiveness of Chain-of-Thought prompting for ChatGPT, a reinforcement learning method that hacks Google’s reCAPTCHA with a staggering 97.4% success rate, and the intriguing tendency of advanced Language Models to develop human-like mistakes in common-sense reasoning. We’ll also discuss the state-of-the-art Swin Transformer Hierarchical Vision Transformer and the potential of GPT-4 for instruction-following agents. As always, we’ll bring you insights from the lively discussions on Hacker News, shedding light on these fascinating developments in AI research.

Top Papers

1) Chain-of-Thought Prompting for ChatGPT

Summary:

The article discusses the effectiveness of Chain-of-Thought prompting for ChatGPT in generating step-by-step rationale for reasoning tasks and proposes Dataset Inference Attack as an essential step to investigate pre-training recipe for possible leakage of pre-training datasets and instructions.

View PDF | Chat with this paper

• Chain-of-Thought (CoT) prompting improves reasoning in ChatGPT for tasks such as arithmetic reasoning.
• CoT prompting involves a two-step reasoning process to prompt the model for the rationale and answer.
• ChatGPT’s pre-training stage shows better performance in symbolic reasoning tasks than arithmetic reasoning tasks.
• CoT prompting outperforms standard prompting and trigger words in generating step-by-step rationale for reasoning tasks.
• Dataset Inference Attack (DIA) can investigate LLMs’ pre-training recipe for possible leakage of pre-training datasets and instructions.

2) Hacking Google reCAPTCHA with Reinforcement Learning

Summary:

Researchers develop a reinforcement learning method to bypass Google’s reCAPTCHA v3, achieving a 97.4% success rate and highlighting the vulnerability of AI systems to automated attacks.

View PDF | Chat with this paper

• A reinforcement learning (RL) approach was proposed to defeat Google’s reCAPTCHA v3.
• The approach achieved over 90% success rate using a divide and conquer strategy.
• The RL agent was trained on a grid world of a specific size and applied the trained policy to the reCAPTCHA environment.
• The proposed RL agent passes the reCAPTCHA test with 97.4% accuracy, which is the first attempt to defeat reCAPTCHA v3 using RL.
• The performance of the agent drops when the cell size of the grid world is varied.
• The vulnerability of AI systems based on ML algorithms such as reCAPTCHA v3 to automated attacks is highlighted, raising questions about AI safety and ethics.

3) Converging Towards Common Sense GPT Analysis

Summary:

The study examines the use of Language Models (LLMs) to approximate common sense and suggests a dynamic generative benchmark called ETR to test LLM performance, comparing GPT outputs to human judgment based on the ETR61 benchmark and finding that larger and more advanced LLMs may develop a tendency towards more human-like mistakes, with the ETR view providing a framework for understanding common-sense reasoning and improving GPT analysis.

View PDF | Chat with this paper

• GPT models have been studied for their common-sense reasoning abilities and susceptibility to fallacies.
• The ETR benchmark has been used to test LLM performance and generate synthetic datasets of fallacy-prone problems.
• Prompt engineering can improve the accuracy of GPT outputs and mitigate systematic mistakes, but increased training and model size may also increase susceptibility to fallacies.
• Later generations of GPT models show improvements in correct reasoning but also produce more fallacies.
• The ETR view provides a framework for understanding common-sense reasoning and can be used to improve GPT analysis.

4) Swin Transformer Hierarchical Vision Transformer

Summary:

The Swin Transformer is a scalable hierarchical vision transformer that achieves state-of-the-art accuracy in object detection and semantic segmentation, with multiple variants and improved performance through the use of tokens, shifted windows, and an AdamW optimizer.

View PDF | Chat with this paper

• The Swin Transformer is a new hierarchical vision transformer that uses shifted windows to model visual entities of various scales and resolutions, achieving strong performance on various vision tasks.
• The Swin Transformer block is scalable and suitable for image classification, object detection, and semantic segmentation, with four variants with different channel numbers and layer numbers.
• The Swin Transformer achieves state-of-the-art performance on object detection and instance segmentation tasks, outperforming other backbones like EfficientNet and RegNet.
• The Swin Transformer improves image classification with absolute position embedding and relative position bias, utilizing shifted window partitioning and self-attention modules to achieve high efficiency.
• The proposed architecture for object detection achieves a better speed-accuracy trade-off than ResMLP and MLP-Mixer, using a hierarchical design and the shifted window approach.

5) Fine-Tuning with GPT-4 Instruction Generation

Summary:

The article explores recent projects and papers related to language models, with a focus on fine-tuning, multitasking, and structured knowledge grounding, including the potential for using GPT-4 for reinforcement learning and instruction-following agents.

View PDF | Chat with this paper

• The use of HHH alignment criteria for human evaluation of responses generated by the Shortcuts model
• Recent papers and projects related to language models, including fine-tuning, multitasking, and prompt engineering
• The performance of chatbots fine-tuned with GPT-4-generated data in generating and following instructions
• The effectiveness of GPT-4-generated data for instruction-tuning of LLMs
• The potential for using GPT-4 instruction-following instances to train larger LLaMA models for higher performance