Guidelines for Prompt Generation
Step 1 - Understand the Content in the Image
oal:Determinewhatishappeningintheimageandformaclearideaofwhatyouwanttoask
G
the model to do (e.g., create, generate, or describe something).
ction: If you're unsureabouttheimagecontent,conductaquickonlinesearch(e.g.,Google
A
imagesearch)togetmoreclarityonwhatdataisbeingpresentedordescribed,orwhatmetrics
it may be including.
Example:
Image: 27075ecb69017e88a145ac06792ea5f4.jpg
Your understanding of the image: This image isachartoftheperiodictableofelementsin
French
Prompt:"Tellmemoreabouttheelementsinthelastlineoftheimageshownandgivemeafun
fact about each of these elements."
tep 2 - Setting the context: Logical, Stepwise
S
Description of the Prompt
oal: Create a coherent structure that breaks down the prompt in a clear, logical manner.
G
Describe the scenario step by step, providingdetailsaboutkeyelementsyouwantanswered.
Specify any particular actions or outcomes.
Example: 261091dc84e1d92c533db113a8cb99c2.webp
Say you want to ask the model a series of related questions about this image such as -
1. I need a list of the vehicles and the percentage of accidents caused
2. I need it grouped by the vehicle type - Example - 2 wheeler, 4 wheeler, 4+ wheeler
rompt: "From the image, I need a list of vehicles along with the percentage of accidents
P
causedbyeachtypeofvehicle,groupedbyvehiclecategoryof2-wheelers,4-wheelers,and4+
wheelers."
Step 3 - Getting creative
oal:InorderforustoensurethatLLMsaretrainedeffectively,it’simportanttoensurethatthe
G
prompt we ask is unique, creative and robust. It’s best to rely on one’s own subject matter
expertise if you already know what the image is about and generatesubject-specificprompts
that will allow you to critically test the model’s understanding of the subject. For instance, if
you’reaPhysicsmajor,andyou’representedwithanimageabouttheinteractionofthedifferent
wavelengths of light with photosensitive substances, you may already know a lot about the
subject that will allow you to tweak your questions in a specific manner to allow for optimal
testing against specific questions.
ometimes, you may not alwaysknowwhattheimagemaybeabout,it’sbesttomakeuseof
S
what you maynotknow,orwhatyoumightneedfromthemodelthatwillhelpyouunderstand
theimagebetter.Forinstance,Ifanimageisaboutastockprice,andyoumaynotunderstand
the stock market trends, then your promptcouldbestructuredinsuchawaythatyouaskthe
model to help you interpret the image, or parts of the imagetosimplifycomplexconceptsfor
you
sageneralrulehowever,It’sbestnottodelimityourselvesfromcreatingpromptswithsimple
A
templates such as -
1. Describe XX from the image
2. Could you help me find the [sum/average/ other simple extractive tasks] from the image?
3. Describe what’s happening in this image for me in 100 words or fewer.
tep 4 - (Optional) - Provide Similar Prompts and
S
adopting a persona to guide the Model
oal:Optingapersona-Provideareferencepromptthatexplainshowyouexpecttheoutput
G
to be structured, or the type of language you prefer in the output.
xample: 22595b7c11403fe46ba4528203c19138.png
E
You’relookingtogenerateasimplifiedversionoftheinformationfromthisdiagramforstudents
interested in entrepreneurship.
rompt: "Imagine you’re a Social Studies teacher for Grade 8, and you want to explain the
P
contents in this picture toyourstudents.Givemeadescriptionofthisimageinamaximumof
200 words"
oal:Providingatemplate-Showthemodelhowyouexpectittogeneratecontentbyoffering
G
similar examples or clarifying expectations.
xample: 22595b7c11403fe46ba4528203c19138.png
E
You’relookingtogenerateadescriptionoftheimage,butyou’reonlyconcernedaboutalarger
organization
rompt:
P
“Describe the image here using the following template -
1. Name of the Growth Phase:
2. Description of the issues faced by a large organization during the phase:
3. Solutions to mitigate problems encountered during the growth phase: ”
Step 5 - Ensuring Proper Grammar and Syntax
oal: Review and fine-tune the prompt to ensure clarity,correctness,andflow.Usetoolslike
G
Grammarly for grammarandsyntaxchecks.Checkforgrammaticalerrors,refinewordchoice,
and ensure the prompt is concise yet descriptive.
Steps to achieve the goal
Grammarly (Browser Extension & Online Tool)
● H owtouse:InstalltheGrammarlyextensioninyourbrowser(e.g.,Chrome,Firefox)or
visittheGrammarlywebsite.Itautomaticallychecksgrammar,punctuation,andspelling
as you type in various text fields like emails, documents, or social media posts.
● Browser Extension Link:Grammarly for Chrome
Hemingway Editor (Online Tool)
1. H ow touse:GotoHemingwayEditor.Pasteyourtext,andthetoolhighlightscomplex
sentences, passive voice, and unnecessary adverbs to improve readability.
2. Example: The sentence "The cat quickly ran across the very large room" might be
flagged for clarity and simplicity, with suggestions like removing "very" or replacing
"quickly" with a simpler verb.
LanguageTool (Browser Extension & Online Tool)
1. H owtouse:InstalltheextensionorusetheLanguageToolwebsite.Itsupportsmultiple
languages and catches errors in sentence structure,grammar, and punctuation.
2. Browser Extension Link:Grammar Checker for Chrome
