INSIGHT CUBE, operated by グラッドキューブ, published its latest research report based on response data from 21 services and 25,281 responses measured by LLMOA. The article states that AI responses change every time and that the proportion of questions in which the company name appears every time is approximately 3%.
A research report using verification data from グラッドキューブ's LLMOA (Elmore) was published on INSIGHT CUBE, the marketing media platform operated by the company. The report is titled “AI Responses Change Every Time | The Company Name Appears in Only 3% of Questions [LLMOA's 25,000-Response Measurement Report],” and is said to cover response data from 21 services and 25,281 responses.
The report cites the expansion of zero-click searches driven by the spread of generative AI as background to the research, and points to the importance of effectiveness measurement and monitoring methods that provide accurate reproducibility in the age of AI. The article explains an analysis aimed at quantitatively clarifying discrepancies (errors) in the data.
The research is said to show that AI responses are inconsistent in some situations, with specific company information being quoted or mentioned in approximately 3% of cases. The article states that details of the services covered and the aggregation methodology can be found in the main text.