> ## Documentation Index
> Fetch the complete documentation index at: https://crowdlisten.com/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Filter discovered content for relevance before deep extraction

> Filter discovered content for relevance before deep extraction.

Runs the LLM relevance classifier on a list of lightweight source
items and returns per-item verdicts plus a recommended-for-extraction
URL list.  Designed to be called between discovery (search) and
expensive extraction (transcript / full-text fetch) so that only
relevant or marginal sources are extracted.



## OpenAPI

````yaml /api/openapi.json post /agent/v1/ingest/filter
openapi: 3.1.0
info:
  title: CrowdListen Agent API
  description: >-
    Configure sources, collect and retain originals, run durable analysis, and
    read or revise cited insights. Humans and agents share authorized
    entity/project records, research jobs and evidence history.
  version: 1.0.0
servers:
  - url: https://agent.crowdlisten.com
    description: Production
  - url: http://localhost:8000
    description: Local development
security: []
paths:
  /agent/v1/ingest/filter:
    post:
      tags:
        - ingest
      summary: Filter discovered content for relevance before deep extraction
      description: |-
        Filter discovered content for relevance before deep extraction.

        Runs the LLM relevance classifier on a list of lightweight source
        items and returns per-item verdicts plus a recommended-for-extraction
        URL list.  Designed to be called between discovery (search) and
        expensive extraction (transcript / full-text fetch) so that only
        relevant or marginal sources are extracted.
      operationId: ingest_filter_agent_v1_ingest_filter_post
      requestBody:
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/FilterRequest'
        required: true
      responses:
        '200':
          description: Successful Response
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/FilterResponse'
        '422':
          description: Validation Error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/HTTPValidationError'
components:
  schemas:
    FilterRequest:
      properties:
        entity_id:
          type: string
          maxLength: 100
          minLength: 1
          title: Entity Id
        question:
          type: string
          maxLength: 5000
          minLength: 1
          title: Question
        sources:
          items:
            $ref: '#/components/schemas/FilterSourceItem'
          type: array
          maxItems: 200
          minItems: 1
          title: Sources
      type: object
      required:
        - entity_id
        - question
        - sources
      title: FilterRequest
    FilterResponse:
      properties:
        verdicts:
          items:
            $ref: '#/components/schemas/FilterVerdict'
          type: array
          title: Verdicts
        recommended_for_extraction:
          items:
            type: string
          type: array
          title: Recommended For Extraction
        stats:
          additionalProperties: true
          type: object
          title: Stats
      type: object
      required:
        - verdicts
        - recommended_for_extraction
        - stats
      title: FilterResponse
    HTTPValidationError:
      properties:
        detail:
          items:
            $ref: '#/components/schemas/ValidationError'
          type: array
          title: Detail
      type: object
      title: HTTPValidationError
    FilterSourceItem:
      properties:
        url:
          type: string
          maxLength: 5000
          title: Url
          default: ''
        title:
          type: string
          maxLength: 2000
          title: Title
          default: ''
        snippet:
          type: string
          maxLength: 10000
          title: Snippet
          default: ''
        platform:
          $ref: '#/components/schemas/Platform'
        engagement:
          $ref: '#/components/schemas/EngagementData'
      type: object
      required:
        - platform
      title: FilterSourceItem
    FilterVerdict:
      properties:
        index:
          type: integer
          title: Index
        url:
          type: string
          title: Url
        verdict:
          type: string
          title: Verdict
        platform:
          type: string
          title: Platform
        status:
          type: string
          title: Status
          default: unreviewed
        model:
          anyOf:
            - type: string
            - type: 'null'
          title: Model
      type: object
      required:
        - index
        - url
        - verdict
        - platform
      title: FilterVerdict
    ValidationError:
      properties:
        loc:
          items:
            anyOf:
              - type: string
              - type: integer
          type: array
          title: Location
        msg:
          type: string
          title: Message
        type:
          type: string
          title: Error Type
      type: object
      required:
        - loc
        - msg
        - type
      title: ValidationError
    Platform:
      type: string
      enum:
        - reddit
        - youtube
        - tiktok
        - twitter
        - instagram
        - linkedin
        - hackernews
        - producthunt
        - github
        - threads
        - web
        - granola
        - slack
        - agent
        - claude_code
        - codex
      title: Platform
    EngagementData:
      properties:
        likes:
          anyOf:
            - type: integer
              minimum: 0
            - type: 'null'
          title: Likes
        comments:
          anyOf:
            - type: integer
              minimum: 0
            - type: 'null'
          title: Comments
        views:
          anyOf:
            - type: integer
              minimum: 0
            - type: 'null'
          title: Views
        score:
          anyOf:
            - type: integer
              minimum: 0
            - type: 'null'
          title: Score
        shares:
          anyOf:
            - type: integer
              minimum: 0
            - type: 'null'
          title: Shares
      type: object
      title: EngagementData

````

This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.