본문 바로가기
  • Home

Implementing a Finance Chatbot using Groq API

  • Journal of Internet of Things and Convergence
  • Abbr : JKIOTS
  • 2026, 12(2), pp.71~77
  • Publisher : The Korea Internet of Things Society
  • Research Area : Engineering > Computer Science > Internet Information Processing
  • Received : January 9, 2026
  • Accepted : February 23, 2026
  • Published : April 30, 2026

Tae-O Lee 1 KIM, TAEKOOK 1

1국립부경대학교

Accredited

ABSTRACT

Conventional financial chatbots based on Large Language Models (LLMs) face limitations in reflecting volatile real-time market data due to their reliance on static, pre-trained parameters. Furthermore, existing systems that integrate external information often perform searches and tool invocations regardless of the specific nature of the query, leading to unnecessary computational overhead and increased response latency. To address these efficiency challenges, this study proposes a "Conditional Tool-Augmented Generation" architecture that dynamically determines the necessity of external data access by identifying user query intent. The proposed system was implemented using the LLaMA 3.1 70B model within the Groq Cloud’s LPU (Language Processing Unit) environment. For queries requiring real-time financial information, the system retrieves the latest stock prices and historical time-series data via the Yahoo Finance API; meanwhile, queries regarding general economic concepts are processed through the model's internal knowledge using few-shot prompting techniques. Additionally, a dialogue memory module is integrated to maintain contextual consistency throughout the conversation. Experimental results demonstrate that the proposed conditional invocation strategy ensures the freshness of information while optimizing indiscriminate external API calls, thereby significantly enhancing overall response performance and cost-efficiency.

Citation status

* References for papers published after 2024 are currently being built.