Taxonomy, Google Gemini, and organism identification from images
In Nature Volume 652 from 16 April 2026 on page 543 Chris Bivins argues that the world needs more taxonomists. One particular line in the article caught my attention, "But when I find a fungus that lacks a name, I can still hold it, examine it under a microscope, compare it to known species and begin the work of description. An LLM cannot. It has no access to the physical world, only to text." That LLM's only have access to text is simply not true. LLM's are now quite proficient at image analysis. Give the LLM images of known fungal species and the LLM can begin the work of description, potentially highlighting similarities and differences to known species. I gave Google Gemini app this image: And the prompt "Describe this photo along with the likely identification of the organisms in the photo." The response started at the blue diamond: This image captures a close-up look at a brush-footed butterfly resting amidst lush green foliage. Visual Description The...