A new research report from ShelfGlance exposes a significant bug in Shopify's agent-commerce platform: the system's category filter returned unfiltered results across all 190 stores tested. The findings, posted to Hacker News on September 2, suggest that developers relying on this filtering mechanism may have been unknowingly serving customers incorrect product catalogs.
What Went Wrong With Category Filtering
According to the research published at shelfglance.com/research/ucp-category-filter, Shopify's agent-commerce implementation contains a flaw in its Universal Commerce Platform (UCP) category filter. Rather than returning only products matching specified categories, the system appears to have ignored filter parameters entirely, returning complete catalogs regardless of requested constraints.
Testing Methodology and Scale
The research team evaluated 190 distinct storefronts running on Shopify's platform, systematically testing category filtering behavior across different product types and store configurations. Every single instance failed to properly apply category restrictions, indicating the issue likely stems from a core component in Shopify's agent-commerce infrastructure rather than isolated merchant configuration problems.
Implications for Developers Building on Agent Commerce
This discovery raises red flags for developers who have integrated Shopify's agent commerce APIs into their applications. Any filtering logic built atop this system would be fundamentally broken, potentially surfacing irrelevant products to customers or exposing entire inventory when specific categories were requested.
The Technical Root Cause Appears Systemic
Unlike typical configuration errors that affect individual stores, the blanket failure across all 190 test stores points toward a systemic issue in Shopify's backend filtering logic. This suggests the bug may originate from a recent update to their agent-commerce infrastructure or an underlying architectural flaw in how category parameters are processed.
Key Takeaways
- Category filtering in Shopify's agent commerce failed 100% of tests across 190 stores
- The issue appears systemic rather than store-specific, pointing to backend logic problems
- Developers using these filters may have shipped broken product discovery features
- Shopify has not yet issued an official statement on the research findings
The Bottom Line
When your category filter doesn't actually filter anything across every single test case, that's not a bugβthat's a fundamental architectural failure. If you're running agent commerce integrations on Shopify, audit your filtering logic immediately before your users start seeing random products instead of what they actually requested.