Machine learning books and papers

JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generation

We present JanusFlow, a powerful framework that unifies image understanding and generation in a single model. JanusFlow introduces a minimalist architecture that integrates autoregressive language models with rectified flow, a state-of-the-art method in generative modeling. Our key finding demonstrates that rectified flow can be straightforwardly trained within the large language model framework, eliminating the need for complex architectural modifications. To further improve the performance of our unified model, we adopt two key strategies: (i) decoupling the understanding and generation encoders, and (ii) aligning their representations during unified training. Extensive experiments show that JanusFlow achieves comparable or superior performance to specialized models in their respective domains, while significantly outperforming existing unified approaches across standard benchmarks. This work represents a step toward more efficient and versatile vision-language models.

Paper: https://arxiv.org/pdf/2411.07975v1.pdf

Code: https://github.com/deepseek-ai/janus

Datasets: GQA MMBench MM-Vet SEED-Bench

@Machine_learn

📃 Perspectives on Computational Enzyme Modeling: From Mechanisms to Design and Drug Development


📎 Study the paper


@Machine_learn

در پروژه MedicalRec ما نياز به يه نفر جهت مشاركت داريم(جايگاه ٧)

Project Title: MedRec: Medical recommender system for image classification without retraining

Github: https://github.com/Ramin1Mousa/MedicalRec

Journal: IEEE Transactions on Pattern Analysis and Machine Intelligence

Impact factor: 20.8


🔸 7- 200$❌
جهت مشارکت می تونید به ایدی بنده پیام بدین.

🧠🧠🧠🧠🧠
@Raminmousa

Foundations of Geometry. DAVID HILBERT, PH. D.

📚 Book


@Machine_learn

⭐️ Fast Think-on-Graph: Wider, Deeper and Faster Reasoning of Large Language Model on Knowledge Graph

🖥 Github: https://github.com/dosonleung/fasttog

📕 Paper: https://arxiv.org/abs/2501.14300v1


@Machine_learn

Discrete Matematics and applications

🔗 link

@Machine_learn

Click-Calib: A Robust Extrinsic Calibration Method for Surround-View Systems

Surround-View System (SVS) is an essential component in Advanced Driver Assistance System (ADAS) and requires precise calibrations.

Paper: https://arxiv.org/pdf/2501.01557v2.pdf

Code: https://github.com/lwangvaleo/click_calib

Dataset: WoodScape

@Machine_learn