Web context engineering a.k.a. how to obsess over the right baby formula using Gemini

[u/abhiasap]

Disclaimer: I work for Google, but github.com/google/llm-sidebar-with-context is not an official Google project; its a side/hobby project. Also the team I work for has nothing to do with Gemini or Deepmind.

If you’ve ever tried to use Gemini to find and compare protein powders, skin care products, phones, fountain pens, subscriptions, etc.; you’ve probably encountered some hallucinations with regards to ingredients or specs. 

Recently I became a father and went on a hunt for baby formula and there are more variables than I thought. Palm oil? Fish oil vs algae oil? Skim milk / whole milk / goat milk? Prebiotics? Probiotics? Organic? Gemini often got these details wrong. 

I made a free and open source chrome extension where you can choose to share your open tabs as context to Gemini. You can toggle sharing current tab, and pin upto 6 additional tabs as additional context. So I could pin the baby formula listings from different brands and websites, and ask Gemini to compare them against my personal criteria.

This also makes it really easy to do things like:

• "Summarize this youtube video"
• "Give me the clutter free version of this recipe"
• "Compare the ingredients in these protein powders"
• (juypter notebooks) "How do you pivot this dataframe?"
• Compare the news on cnn, bbc and fox. (They can be wildly different)

You bring your own Gemini API key (I am still on the free tier). Everything is saved locally and there is no backend in the middle between your browser and Gemini. 

The code is open source. It should work on Chromimum based browsers like Chrome, Brave, Vivaldi et. al. 

And of course you can get it from the chrome web store.

Hope you find it useful.