Academic | YuyaoGe's Website

A Survey of Context Engineering for Large Language Models

The performance of Large Language Models (LLMs) is fundamentally determined by the contextual information provided during inference. …

Lingrui Mei, Jiayu Yao, Yuyao Ge 葛钰峣, Yiwei Wang, Baolong Bi, Yujun Cai, Jiazhi Liu, Mingyu Li, Zhong-Zhi Li, Duzhen Zhang, Chenlin Zhou, Jiayi Mao, Tianze Xia, Jiafeng Guo, Shenghua Liu

Who is in the Spotlight: The Hidden Bias Undermining Multimodal Retrieval-Augmented Generation

Multimodal Retrieval-Augmented Generation (RAG) systems have become essential in knowledge-intensive and open-domain tasks. As …

Jiayu Yao, Shenghua Liu, Yiwei Wang, Lingrui Mei, Baolong Bi, Yuyao Ge 葛钰峣, Zhecheng Li, Xueqi Cheng

PIS:Linking Importance Sampling and Attention Mechanisms for Efficient Prompt Compression

Large language models (LLMs) have achieved remarkable progress, demonstrating unprecedented capabilities across various natural …

Lizhe Chen, Binjia Zhou, Yuyao Ge 葛钰峣, Jiayi Chen, Shiguang NI

PIS:Linking Importance Sampling and Attention Mechanisms for Efficient Prompt Compression

a1: Steep Test-time Scaling Law via Environment Augmented Generation

Large Language Models (LLMs) have made remarkable breakthroughs in reasoning, yet continue to struggle with hallucinations, logical …

Lingrui Mei, Shenghua Liu, Yiwei Wang, Baolong Bi, Yuyao Ge 葛钰峣, Jun Wan, Yurong Wu, Xueqi Cheng

a1: Steep Test-time Scaling Law via Environment Augmented Generation

Innate Reasoning is Not Enough : In-Context Learning Enhances Reasoning Large Language Models with Less Overthinking

TBD

Yuyao Ge 葛钰峣, Shenghua Liu, Yiwei Wang, Lingrui Mei, Lizhe Chen, Baolong Bi, Xueqi Cheng

Can Graph Descriptive Order Affect Solving Graph Problems with LLMs?

In this work, we propose a Dynamically Adaptive Density Control Strategy based on the degree of reconstruction of the background of the scene, which adaptive the spatial sample point generation strategy dynamically according to the training results and prevents the generation of redundant data in the model.

Yuyao Ge 葛钰峣, Shenghua Liu, Baolong Bi, Yiwei Wang, Lingrui Mei, Wenjie Feng, Lizhe Chen, Xueqi Cheng

Can Graph Descriptive Order Affect Solving Graph Problems with LLMs?

Translating Words to Worlds: Zero-Shot Synthesis of 3D Terrain from Textual Descriptions Using Large Language Models

The current research on text-guided 3D synthesis predominantly utilizes complex diffusion models, posing significant challenges in …

Guangzi Zhang, Lizhe Chen, Yu Zhang, Yan Liu, Yuyao Ge 葛钰峣, Xingquan Cai

Translating Words to Worlds: Zero-Shot Synthesis of 3D Terrain from Textual Descriptions Using Large Language Models

Frequency-Importance Gaussian Splatting for Real-Time Lightweight Radiance Field Rendering

In this work, we propose a Dynamically Adaptive Density Control Strategy based on the degree of reconstruction of the background of the scene, which adaptive the spatial sample point generation strategy dynamically according to the training results and prevents the generation of redundant data in the model.

Lizhe Chen, Yan Hu, Yu Zhang, Yuyao Ge 葛钰峣, Haoyu Zhang, Xingquan Cai

llama模型量化报告(二)

LLM.int8的进一步研究及Emergent feature现象

Yuyao Ge 葛钰峣

Aug 11, 2023 1 min read 论文分享

llama模型量化报告(一)

大模型量化基础知识及LLM.int8量化

Yuyao Ge 葛钰峣

Aug 4, 2023 2 min read 论文分享