Release v5.4.0: PaddlePaddle models 🙌, Mistral 4, PI0, VidEoMT, UVDoc, SLANeXt, Jina Embeddings v3
Release v5.4.0: PaddlePaddle models 🙌, Mistral 4, PI0, VidEoMT, UVDoc, SLANeXt, Jina Embeddings v3 huggingface / transformers Public Notifications You must be signed in to change notification settings Fork 34.7k Star 167k Release v5.4.0: PaddlePaddle models 🙌, Mistral 4, PI0, VidEoMT, UVDoc, SLANeXt, Jina Embeddings v3 LysandreJik released this 27 Mar 00:33 · 1663 commits to main since this release v5.4.0 276f140 New Model additions VidEoMT Video Encoder-only Mask Transformer (VidEoMT) is a lightweight encoder-only model for online video segmentation built on a plain Vision Transformer (ViT). It eliminates the need for dedicated tracking modules by introducing a lightweight query propagation mechanism that carries information across frames and employs a query fusion strategy that combines propagated queries with temporally-agnostic learned queries.
This ModelRelease is relevant to the technology intelligence record because it involves Mistral AI, GitHub, Meta, DeepSeek. The source article should remain the factual reference for follow-up coverage.
- huggingface / transformers Public Notifications You must be signed in to change notification settings Fork 34.7k Star 167k Release v5.4.0: PaddlePaddle models 🙌, Mistral 4, PI0, VidEoMT, UVDoc, SLANeXt, Jina Embeddings v3 LysandreJik released this 27 Mar 00:33 · 1663 commits to main since this release v5.4.0 276f140 New Model additions VidEoMT Video Encoder-only Mask Transformer (VidEoMT) is a lightweight encoder-only model for online video segmentation built on a plain Vision Transformer (ViT).
- It eliminates the need for dedicated tracking modules by introducing a lightweight query propagation mechanism that carries information across frames and employs a query fusion strategy that combines propagated queries with temporally-agnostic learned queries.
- VidEoMT achieves competitive accuracy while being 5x-10x faster than existing approaches, running at up to 160 FPS with a ViT-L backbone.
- Links: Documentation | Paper Add VidEoMT ( #44285 ) by @NielsRogge in #44285 UVDoc UVDoc is a machine learning model designed for document image rectification and correction.
- The main purpose of this model is to carry out geometric transformation on images to correct document distortion, inclination, perspective deformation and other problems in document images.
- It provides both single input and batched inference capabilities for processing distorted document images.