Skip to content

vllm.transformers_utils.configs.tarsier2

Tarsier2Config

Bases: Qwen2VLConfig

Tarsier2's config.json is written such that AutoConfig.from_pretrained will create a deeply nested config consisting of:

  • LlavaConfig
  • Qwen2VLConfig
    • Qwen2VLTextConfig
    • Qwen2VLVisionConfig
  • Qwen2VLConfig
    • Qwen2VLTextConfig
    • Qwen2VLVisionConfig

When it should really just be a single Qwen2VLConfig.

This class is a hack to stop AutoConfig from creating the nested config structure.

Source code in vllm/transformers_utils/configs/tarsier2.py 
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
class Tarsier2Config(Qwen2VLConfig):
    """
    Tarsier2's config.json is written such that AutoConfig.from_pretrained will create
    a deeply nested config consisting of:

    - LlavaConfig
      - Qwen2VLConfig
        - Qwen2VLTextConfig
        - Qwen2VLVisionConfig
      - Qwen2VLConfig
        - Qwen2VLTextConfig
        - Qwen2VLVisionConfig

    When it should really just be a single Qwen2VLConfig.

    This class is a hack to stop AutoConfig from creating the nested config structure.
    """

    model_type = "tarsier2"

model_type class-attribute instance-attribute 

model_type = 'tarsier2'