Personal Learnings← Lenny's Newsletter  Library

Lenny's Newsletter · Product & Work

Five proven prompt engineering techniques (and a few more-advanced tactics)

TIER 4   2024-10-29

❤️‍🔥 A quick note on the Lenny and Friends Summit

  1. The inaugural Lenny and Friends Summit was a smashing success. I shared some reflections on LinkedIn and X.
  2. If you couldn’t make it, videos of the talks from the Summit will be going up on my YouTube channel over the next couple of weeks. Subscribe to catch them as they come out.
  3. My live podcast recording with Shreyas Doshi will be coming out this Thursday as an episode in your regular podcast feed.

Image from Five proven prompt engineering techniques (and a few more-advanced tactics)

I’m constantly hearing about people doing mind-blowing things with AI, like building entire products, offloading big parts of their job, and saving hundreds of hours doing research. But most of the time when I try using ChatGPT/Claude/Gemini, I get very meh results. Maybe you’re having the same luck.

The difference, I’m learning, is in crafting your prompts. The nuance and skill needed to get good results became clear to me when Mike Taylor published his guest post “How close is AI to replacing product managers?” and included prompts that did unexpectedly well in a blind test vs. human performance. I wanted to learn more—and so did many readers who emailed me after that post came out. I asked Mike to write a deeper dive just on prompt engineering.

Mike is a full-time professional prompt engineer. He wrote a book for O’Reilly on prompt engineering and created a course on AI taken by 100,000 people, and over the past few years he’s built up a collection of techniques that have proven useful again and again. Below, Mike shares the five prompting techniques he’s found to have the most impact when prompting LLMs, plus three advanced bonus techniques if you want to go further down the rabbit hole.

For more from Mike, check out his book, Prompt Engineering for Generative AI, and his AI engineering studio, Brightpool. Follow him on LinkedIn and X.

Image from Five proven prompt engineering techniques (and a few more-advanced tactics)

Much like how becoming a better communicator leads to better results from the people you work with, writing better prompts improves the responses you can get from AI. We already know that people can’t read our minds. But neither can AI, so you have to tell it what you want, as specifically as possible.

Say you’re asking ChatGPT to write an announcement for a new feature. You want to make sure the phrasing is attention-grabbing and factual but that the message is also authentic to your product and customer base. Naively asking ChatGPT to do the task without giving it any real direction will likely result in a generic response that leans too heavily on emojis and over-enthusiastic corporate speak.

Image from Five proven prompt engineering techniques (and a few more-advanced tactics)

With no stylistic direction, you’ll get one of these fake, corporate-sounding responses, because that’s the average of what’s out there. The same thing might happen if you delegated this task to a member of your team without being clear about what you actually want. One quick trick: ChatGPT is capable of emulating any famous style or format—you just need to specify that in your prompt so it knows what you’re looking for. Something as simple as appending the words “in the style of [insert famous person]” can make a huge difference to the results you get.

Image from Five proven prompt engineering techniques (and a few more-advanced tactics)

Specifying a style is just one tactic, though, and there are hundreds of prompt engineering techniques, many of them proven effective in scientific studies. The good news is that you don’t have to read through all those papers on ArXiv. Every week, I spend a full day researching and experimenting with the latest techniques, and in this post, I’ll walk you through the five easy-to-use prompt engineering tactics that I actually use day-to-day, plus three more that are a bit more advanced and tailored to certain circumstances. What’s more, I’ll give you plug-and-play templates you can start using today to improve your own prompts.

My five favorite prompt engineering tactics

Image from Five proven prompt engineering techniques (and a few more-advanced tactics)

These techniques work across any large language model, so whether you use ChatGPT, Claude, Gemini, or Perplexity, you can get better results. I’ve included examples of how these techniques work, what problems they solve for, and when to use them. Most are backed by scientific evidence, so I’ve also linked to those papers for further reading.

With today’s latest models, there’s a lot less need for prompting tricks than there was back in 2020 with GPT-3. However, no matter how smart AI gets, it’ll always need guidance from you, and the more guidance you give it, the better results you’ll get. The types of tactics I’ve focused on in this list are ones that I anticipate will continue to be useful far into the future.

Tactic 1: Role-playing

Role-playing is the technique we already demonstrated, where you instruct the AI to assume the persona of an expert, celebrity, or character. This approach leverages the AI’s broad knowledge base to mimic the style, expertise, and perspective of the chosen role. By doing so, you can obtain responses that are more tailored to the specific domain or viewpoint you’re interested in. For example, asking the AI to respond as a renowned scientist might yield more technical and research-oriented answers, while role-playing as a creative writer could result in more imaginative and narrative-driven responses.

Image from Five proven prompt engineering techniques (and a few more-advanced tactics)

Tactic 2: Style unbundling

Style unbundling involves breaking down the key elements of a particular expert’s style or skill set into discrete components. Instead of simply asking the AI to imitate someone, you prompt it to analyze and list the specific characteristics that make up that person’s unique approach. Then you can use those characteristics to prompt the AI to create new content. This technique allows for a more nuanced understanding and application of the desired style. It’s particularly useful when you want to incorporate certain aspects of an expert’s method without fully adopting their persona, giving you more control over which elements to emphasize in the AI’s output.

Image from Five proven prompt engineering techniques (and a few more-advanced tactics)

Tactic 3: Emotion prompting

Emotion prompting is a technique that involves adding emotional context or stakes to your request. By framing the task as personally important or impactful, you can potentially elicit more careful and thoughtful responses from the AI. This method taps into the AI’s programming to be helpful and considerate, potentially leading to more thorough or empathetic outputs. However, it’s important to use this technique judiciously, as it can sometimes have the opposite intention and lead to worse results.

Image from Five proven prompt engineering techniques (and a few more-advanced tactics)

Tactic 4: Few-shot learning

Few-shot learning, also known as in-context learning, is a technique where you provide the AI with a few examples of the task you want it to perform before asking it to complete a similar task. This method helps to guide the AI’s understanding of the specific format, style, or approach you’re looking for. By demonstrating the desired output through examples, you can often achieve more accurate and relevant results, especially for tasks that might be ambiguous or require a particular structure.

Image from Five proven prompt engineering techniques (and a few more-advanced tactics)

Tactic 5: Synthetic bootstrap

Synthetic bootstrap is a practical technique where you use the AI to generate multiple examples based on given inputs. These AI-generated examples can then be used as a form of in-context learning for subsequent prompts or as test cases you can use as inputs for your existing prompt template. This method is particularly useful when you don’t have a lot of real-world examples readily available or when you need a large number of diverse input examples quickly. It allows you to bootstrap the learning process, potentially improving the AI’s performance on the target task even without the help of a domain expert.

Image from Five proven prompt engineering techniques (and a few more-advanced tactics)

BONUS: Three more advanced tactics

If you got this far and still want to push your prompting skills further, the next level up is learning ways to split up the task into multiple steps. Rather than trying to do it all in one prompt, most professionals in the AI space build a system that corrects for the errors AI models commonly make. These tactics can take more time or be harder to implement—particularly if you can’t code—but they can make all the difference when AI is failing at a task. With better structuring interactions with AI, you can leverage its strengths, mitigate weaknesses, and create more robust and reliable outcomes.

Image from Five proven prompt engineering techniques (and a few more-advanced tactics)

Tactic 6: Chain-of-thought

The chain-of-thought technique encourages the AI to break down complex problems into smaller, more manageable steps. By prompting the AI to “think through” a problem step-by-step, you can often obtain more logical, transparent, and accurate results. This method is particularly effective for tasks that require reasoning, problem-solving, or multistep processes. It not only improves the quality of the final answer but also provides insight into the AI’s reasoning process, making it easier to identify and correct any errors in logic. Many AI tools have baked this into their system already (OpenAI’s o1-preview has it trained directly into the model), but I often like to separate planning as its own step, so I can vet the plan before I decide how to proceed.

Image from Five proven prompt engineering techniques (and a few more-advanced tactics)

Tactic 7: Retrieval-augmented generation (RAG)

RAG is a technique that involves providing the AI with relevant contextual information before asking it to perform a task. This method combines the AI’s general knowledge with the data contained in your files and documents and with externally sourced information, allowing for more informed and accurate responses. First, you search for relevant documents (or parts of documents) and then add them to the prompt. RAG is particularly useful when dealing with specialized topics, niche events, or specific datasets that might not be fully covered in the AI’s training data. By augmenting the AI’s knowledge with relevant context, you can obtain more precise and up-to-date outputs.

Image from Five proven prompt engineering techniques (and a few more-advanced tactics)

Note: In this example, the full PDF is inserted into the prompt, but in many systems (including OpenAI’s custom GPTs), only the most relevant parts of the report will be retrieved to insert into the prompt. This is done via a vector search (searching by similarity to the user question being asked).

Tactic 8: LLM-as-a-judge

Human feedback is expensive and slow, so it’s common practice among AI practitioners to use an AI model to evaluate and rate the quality of outputs, either from itself or from other sources. This method leverages the AI’s analytical capabilities to provide a more objective assessment of content quality. It can be particularly useful for tasks like content moderation, quality control, or comparing multiple AI-generated outputs to select the best one. However, it’s important to remember that the AI’s judgments are based on its training and may not always align perfectly with human assessments.

Image from Five proven prompt engineering techniques (and a few more-advanced tactics)

Conclusion

Mastering these prompt engineering techniques will significantly enhance your ability to leverage AI. By writing good instructions, providing more context, and designing better systems, you can overcome many of the common challenges people face when using (and struggling with) AI tools.

These methods allow you to tap into the full potential of AI, whether you’re drafting user stories, conducting competitive analysis, or making complex product decisions. Remember, the key is to experiment with these techniques and adapt them to your specific needs and contexts. As AI continues to evolve, staying updated with these and other strategies will help you maintain a competitive edge.

While AI won’t replace you directly, those who use AI effectively will have an advantage when going for that next promotion or applying for that next job. So bookmark this guide, practice these techniques, and don’t hesitate to iterate on your approaches as you discover what works best for you and your team.

Thanks, Mike!

For more from Mike, check out his book, Prompt Engineering for Generative AI, and his AI engineering studio, Brightpool, and follow him on LinkedIn and X.

Have a fulfilling and productive week 🙏

Hiring? 👀

I’ve got a white-glove recruiting service specializing in senior product roles (e.g. Directors, VPs, and Heads of Product), where I work with a few select companies to fill their open roles. If you’re hiring, apply to work with us below.

Start hiring

If you’re finding this newsletter valuable, share it with a friend, and consider subscribing if you haven’t already. There are group discounts, gift options, and referral bonuses available.

Sincerely,

Lenny 👋