The crawler class taxonomy includes friend-class (legitimate AI and search crawlers that should be served full content), foe-class (commercial intelligence platforms that report on the site to competitors), and neutral classes that fall between depending on operator policy.
Distinguishing crawler classes requires user agent analysis, IP range identification, and behavioral pattern recognition. The IEO Engine gate intelligence system performs this classification in real time, applying different responses to different crawler classes.