{"id":31,"date":"2024-10-12T23:44:27","date_gmt":"2024-10-12T19:44:27","guid":{"rendered":"https:\/\/artenatech.com\/?page_id=31"},"modified":"2024-11-15T14:14:14","modified_gmt":"2024-11-15T10:14:14","slug":"koboldij-llm-integration-plugin-for-ide-intellij-idea","status":"publish","type":"page","link":"https:\/\/artenatech.com\/index.php\/koboldij-llm-integration-plugin-for-ide-intellij-idea\/","title":{"rendered":"LLM Integration Solution"},"content":{"rendered":"\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"318\" height=\"159\" src=\"https:\/\/artenatech.com\/wp-content\/uploads\/2024\/10\/image-1.png\" alt=\"\" class=\"wp-image-33\" style=\"width:660px;height:auto\" srcset=\"https:\/\/artenatech.com\/wp-content\/uploads\/2024\/10\/image-1.png 318w, https:\/\/artenatech.com\/wp-content\/uploads\/2024\/10\/image-1-300x150.png 300w\" sizes=\"auto, (max-width: 318px) 100vw, 318px\" \/><\/figure>\n\n\n<nav class=\"is-responsive wp-block-navigation is-layout-flex wp-block-navigation-is-layout-flex\" aria-label=\"Navigation\" \n\t\t data-wp-interactive=\"core\/navigation\" data-wp-context='{\"overlayOpenedBy\":{\"click\":false,\"hover\":false,\"focus\":false},\"type\":\"overlay\",\"roleAttribute\":\"\",\"ariaLabel\":\"Menu\"}'><button aria-haspopup=\"dialog\" aria-label=\"Open menu\" class=\"wp-block-navigation__responsive-container-open\" \n\t\t\t\tdata-wp-on--click=\"actions.openMenuOnClick\"\n\t\t\t\tdata-wp-on--keydown=\"actions.handleMenuKeydown\"\n\t\t\t><svg width=\"24\" height=\"24\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 24 24\" aria-hidden=\"true\" focusable=\"false\"><path d=\"M4 7.5h16v1.5H4z\"><\/path><path d=\"M4 15h16v1.5H4z\"><\/path><\/svg><\/button>\n\t\t\t\t<div class=\"wp-block-navigation__responsive-container\"  id=\"modal-1\" \n\t\t\t\tdata-wp-class--has-modal-open=\"state.isMenuOpen\"\n\t\t\t\tdata-wp-class--is-menu-open=\"state.isMenuOpen\"\n\t\t\t\tdata-wp-watch=\"callbacks.initMenu\"\n\t\t\t\tdata-wp-on--keydown=\"actions.handleMenuKeydown\"\n\t\t\t\tdata-wp-on--focusout=\"actions.handleMenuFocusout\"\n\t\t\t\ttabindex=\"-1\"\n\t\t\t>\n\t\t\t\t\t<div class=\"wp-block-navigation__responsive-close\" tabindex=\"-1\">\n\t\t\t\t\t\t<div class=\"wp-block-navigation__responsive-dialog\" \n\t\t\t\tdata-wp-bind--aria-modal=\"state.ariaModal\"\n\t\t\t\tdata-wp-bind--aria-label=\"state.ariaLabel\"\n\t\t\t\tdata-wp-bind--role=\"state.roleAttribute\"\n\t\t\t>\n\t\t\t\t\t\t\t<button aria-label=\"Close menu\" class=\"wp-block-navigation__responsive-container-close\" \n\t\t\t\tdata-wp-on--click=\"actions.closeMenuOnClick\"\n\t\t\t><svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 24 24\" width=\"24\" height=\"24\" aria-hidden=\"true\" focusable=\"false\"><path d=\"m13.06 12 6.47-6.47-1.06-1.06L12 10.94 5.53 4.47 4.47 5.53 10.94 12l-6.47 6.47 1.06 1.06L12 13.06l6.47 6.47 1.06-1.06L13.06 12Z\"><\/path><\/svg><\/button>\n\t\t\t\t\t\t\t<div class=\"wp-block-navigation__responsive-container-content\" \n\t\t\t\tdata-wp-watch=\"callbacks.focusFirstElement\"\n\t\t\t id=\"modal-1-content\">\n\t\t\t\t\t\t\t\t<ul class=\"wp-block-navigation__container is-responsive wp-block-navigation\"><li class=\" wp-block-navigation-item wp-block-navigation-link\"><a class=\"wp-block-navigation-item__content\"  href=\"#koboldij\" rel=\"koboldij\"><span class=\"wp-block-navigation-item__label\">KoboldIJ<\/span><\/a><\/li><li class=\" wp-block-navigation-item wp-block-navigation-link\"><a class=\"wp-block-navigation-item__content\"  href=\"#promptJ\"><span class=\"wp-block-navigation-item__label\">PromptJ<\/span><\/a><\/li><li class=\" wp-block-navigation-item wp-block-navigation-link\"><a class=\"wp-block-navigation-item__content\"  href=\"#llmspace\"><span class=\"wp-block-navigation-item__label\">AI Space<\/span><\/a><\/li><li class=\" wp-block-navigation-item wp-block-navigation-link\"><a class=\"wp-block-navigation-item__content\"  href=\"#network\"><span class=\"wp-block-navigation-item__label\">Dream Team<\/span><\/a><\/li><\/ul>\n\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div><\/nav>\n\n\n<h2 class=\"wp-block-heading\" id=\"koboldij\">KoboldIJ &#8211; LLM Integration plugin for IDE Intellij Idea<\/h2>\n\n\n\n<p>The KoboldIJ plugin for IntelliJ IDEA provides seamless integration with a locally hosted Large Language Model (LLM) powered by the KoboldAI (Koboldcpp) environment. This allows developers to make fast, secure, and free LLM requests directly from their development environment without relying on external APIs or public LLM rules. You can leverage any KoboldAI compatible public model, including models fine-tuned to your specific needs using the LoRA (Low-Rank Adaptation) technology.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"654\" height=\"400\" src=\"https:\/\/artenatech.com\/wp-content\/uploads\/2024\/10\/image-4.png\" alt=\"\" class=\"wp-image-36\" style=\"width:661px;height:auto\" srcset=\"https:\/\/artenatech.com\/wp-content\/uploads\/2024\/10\/image-4.png 654w, https:\/\/artenatech.com\/wp-content\/uploads\/2024\/10\/image-4-300x183.png 300w\" sizes=\"auto, (max-width: 654px) 100vw, 654px\" \/><\/figure>\n\n\n\n<p>KoboldAI(Koboldcpp) works across all major operating systems, requiring minimal setup. Just download the model and start using it to enhance your coding experience with local LLMs.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Key Features<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li><em>Simple Setup<\/em>. \n<ul class=\"wp-block-list\">\n<li>Easily configure the plugin and connect to KoboldAI without complex installations.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><em><em>Execution of typical tasks<\/em>.<\/em>\n<ul class=\"wp-block-list\">\n<li><em>The main purpose is the intelligent execution of typical tasks.<\/em><\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><em>Compatibility<\/em>. \n<ul class=\"wp-block-list\">\n<li>Koboldcpp works with a variety of popular operating systems, allowing you to download models and use them immediately.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><em>Local &amp; Secure<\/em>. \n<ul class=\"wp-block-list\">\n<li>By using a locally hosted LLM, you have full control over your data, ensuring security and independence from external services.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-embed is-type-wp-embed is-provider-artena-technologies wp-block-embed-artena-technologies\" style=\"margin-top:0;margin-right:0;margin-bottom:0;margin-left:0\"><div class=\"wp-block-embed__wrapper\">\n<blockquote class=\"wp-embedded-content\" data-secret=\"8b9INcgFoU\"><a href=\"https:\/\/artenatech.com\/index.php\/koboldij-llm-plugin-for-ide\/\">KoboldIJ \u2013 LLM Plugin for IDE<\/a><\/blockquote><iframe loading=\"lazy\" class=\"wp-embedded-content\" sandbox=\"allow-scripts\" security=\"restricted\" style=\"position: absolute; visibility: hidden;\" title=\"&#8220;KoboldIJ \u2013 LLM Plugin for IDE&#8221; &#8212; ArteNa Technologies\" src=\"https:\/\/artenatech.com\/index.php\/koboldij-llm-plugin-for-ide\/embed\/#?secret=Dqjvc2KpB0#?secret=8b9INcgFoU\" data-secret=\"8b9INcgFoU\" width=\"500\" height=\"282\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\"><\/iframe>\n<\/div><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"promptJ\">PromptJ &#8211; platform for organizing a repository LLM and prompts<\/h2>\n\n\n\n<p><strong>PromptJ <\/strong>&nbsp;is a specialized platform for organizing a centralized repository of trained language models (LLM), prompts (queries for interacting with models) and metadata. This server not only provides functions for storing and managing models, but also offers advanced capabilities for remote access, ratings, evaluating the effectiveness of prompts and maintaining prompt registries.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/artenatech.com\/wp-content\/uploads\/2024\/10\/image-10-1024x576.png\" alt=\"\" class=\"wp-image-64\" style=\"width:667px;height:auto\" srcset=\"https:\/\/artenatech.com\/wp-content\/uploads\/2024\/10\/image-10-1024x576.png 1024w, https:\/\/artenatech.com\/wp-content\/uploads\/2024\/10\/image-10-300x169.png 300w, https:\/\/artenatech.com\/wp-content\/uploads\/2024\/10\/image-10-768x432.png 768w, https:\/\/artenatech.com\/wp-content\/uploads\/2024\/10\/image-10-1536x864.png 1536w, https:\/\/artenatech.com\/wp-content\/uploads\/2024\/10\/image-10.png 1600w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"-main-server-functions-\"><strong>Key Features:<\/strong><\/h3>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Storing LLM models and prompts<\/strong>. \n<ul class=\"wp-block-list\">\n<li>Centralized storage for various versions of LLM models (e.g. Mistral, LLaMA, etc.).<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Remote access and RESTful API<\/strong>. \n<ul class=\"wp-block-list\">\n<li>RESTful API and WebSocket support for remote interaction with the model and prompt storage.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Ratings and evaluation of prompt performance<\/strong>\n<ul class=\"wp-block-list\">\n<li>A rating system for evaluating prompts and models by users, based on the efficiency of task execution.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Registry functions<\/strong>.\n<ul class=\"wp-block-list\">\n<li>Registry of LLM models with a description of their characteristics: number of parameters, architecture, training date, domain areas of application.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Moderation and access management<\/strong>.\n<ul class=\"wp-block-list\">\n<li>Ability to create public and private registries of models and prompts.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Interactive analytics and monitoring<\/strong>.\n<ul class=\"wp-block-list\">\n<li>Visualization of the use of models and prompts in real time, including statistics on queries, models and types of tasks.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Collaboration module<\/strong>.\n<ul class=\"wp-block-list\">\n<li>Ability to share prompts and models in teams with comments, tagging and edit histories.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Integration with training and experimental systems<\/strong>.\n<ul class=\"wp-block-list\">\n<li>Support for launching experiments on fine-tuning models through integration with training frameworks (e.g. PyTorch, TensorFlow).<\/li>\n<\/ul>\n<\/li>\n<\/ol>\n\n\n\n<figure class=\"wp-block-embed is-type-wp-embed is-provider-artena-technologies wp-block-embed-artena-technologies\"><div class=\"wp-block-embed__wrapper\">\n<blockquote class=\"wp-embedded-content\" data-secret=\"loXEGPCgGM\"><a href=\"https:\/\/artenatech.com\/index.php\/promptj-your-repository-of-llm-and-prompts\/\">PromptJ \u2013 Your repository of LLM and prompts<\/a><\/blockquote><iframe loading=\"lazy\" class=\"wp-embedded-content\" sandbox=\"allow-scripts\" security=\"restricted\" style=\"position: absolute; visibility: hidden;\" title=\"&#8220;PromptJ \u2013 Your repository of LLM and prompts&#8221; &#8212; ArteNa Technologies\" src=\"https:\/\/artenatech.com\/index.php\/promptj-your-repository-of-llm-and-prompts\/embed\/#?secret=XNrHpiCzKw#?secret=loXEGPCgGM\" data-secret=\"loXEGPCgGM\" width=\"500\" height=\"282\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\"><\/iframe>\n<\/div><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"llmspace\">AISpace \u2014 Platform for Modern AI Analytics in Business<\/h2>\n\n\n\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"786\" height=\"554\" src=\"https:\/\/artenatech.com\/wp-content\/uploads\/2024\/10\/image-11.png\" alt=\"\" class=\"wp-image-96\" style=\"width:590px;height:auto\" srcset=\"https:\/\/artenatech.com\/wp-content\/uploads\/2024\/10\/image-11.png 786w, https:\/\/artenatech.com\/wp-content\/uploads\/2024\/10\/image-11-300x211.png 300w, https:\/\/artenatech.com\/wp-content\/uploads\/2024\/10\/image-11-768x541.png 768w\" sizes=\"auto, (max-width: 786px) 100vw, 786px\" \/><\/figure>\n\n\n\n<p>AISpace is an innovative platform that enables enterprises to use advanced analytics methods and algorithms based on large language models (LLM) to process and analyze business data. AISpace combines the convenience of self-service, unique technologies and tools for rapid creation and implementation of solutions, providing powerful analytical functionality and support for modern AI.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"key-features\">Key Features<\/h3>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Peer-to-peer distributed network for LLM with LoRa support<\/strong>&nbsp;AISpace operates on a peer-to-peer network, which allows you to run large models and effectively manage the load. LoRa support provides the ability to flexibly train and fine-tune models.<\/li>\n\n\n\n<li><strong>Integration with PromprJ<\/strong>&nbsp;The platform allows you to quickly connect to the registry of LLM models and prompts, providing access to the latest LLMs and templates. This significantly reduces development time and ensures readiness to solve specialized problems.<\/li>\n\n\n\n<li><strong>Embedding applications for prompt chains and agents<\/strong> AISpace allows you to create and deploy applications for working with prompt sequences and agents, automating routine processes and improving the efficiency of business processes.<\/li>\n\n\n\n<li><strong>Integration with an agent sandbox<\/strong>&nbsp;The platform supports an agent sandbox, allowing you to test and refine their work before the real launch. This allows you to minimize errors and debug the interaction of agents with business systems.<\/li>\n\n\n\n<li><strong>LLM Marketplace<\/strong>&nbsp;AISpace includes a marketplace for selling and exchanging models, which helps developers and companies share solutions and find the right tools for their tasks.<\/li>\n<\/ol>\n\n\n\n<figure class=\"wp-block-embed is-type-wp-embed is-provider-artena-technologies wp-block-embed-artena-technologies\"><div class=\"wp-block-embed__wrapper\">\n<blockquote class=\"wp-embedded-content\" data-secret=\"s7aMTw2L0d\"><a href=\"https:\/\/artenatech.com\/index.php\/llmspace-platform-for-modern-ai-analytics-in-business\/\">AISpace \u2014 Platform for Modern AI Analytics in Business<\/a><\/blockquote><iframe loading=\"lazy\" class=\"wp-embedded-content\" sandbox=\"allow-scripts\" security=\"restricted\" style=\"position: absolute; visibility: hidden;\" title=\"&#8220;AISpace \u2014 Platform for Modern AI Analytics in Business&#8221; &#8212; ArteNa Technologies\" src=\"https:\/\/artenatech.com\/index.php\/llmspace-platform-for-modern-ai-analytics-in-business\/embed\/#?secret=ZXy1EFC72P#?secret=s7aMTw2L0d\" data-secret=\"s7aMTw2L0d\" width=\"500\" height=\"282\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\"><\/iframe>\n<\/div><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"network\">Dream Team \u2014 simulator agent environment for real-world product development.<\/h2>\n\n\n\n<p>Dream Team is an innovative dual-purpose platform that serves as both a simulator for team-based software development processes and an agent environment for real-world product development.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"225\" height=\"225\" src=\"https:\/\/artenatech.com\/wp-content\/uploads\/2024\/10\/image-13.png\" alt=\"\" class=\"wp-image-107\" style=\"width:496px;height:auto\" srcset=\"https:\/\/artenatech.com\/wp-content\/uploads\/2024\/10\/image-13.png 225w, https:\/\/artenatech.com\/wp-content\/uploads\/2024\/10\/image-13-150x150.png 150w\" sizes=\"auto, (max-width: 225px) 100vw, 225px\" \/><\/figure>\n\n\n\n<p>The system simulates the entire development lifecycle, where all participants\u2014clients, developers, and project managers\u2014are represented as autonomous agents powered by large language models (LLMs). In this simulated environment, agents undergo training, interacting dynamically with both other agents and real developers, building critical skills in development that prepare them for real-world applications.<\/p>\n\n\n\n<p>At the core of Dream Team\u2019s approach is the DevAgent-Zero methodology, which enables agents to continuously improve their capabilities by leveraging extensive knowledge bases and LLM insights, while also learning from both successful and failed scenarios. Simulation results demonstrate that agents in LLM Dev Team can incrementally enhance their productivity and task success, making the platform a powerful tool for analyzing and building agent-developer hybrid teams.<\/p>\n\n\n\n<p>In this way, Dream Team becomes a unique environment where trained agents not only learn but are prepared to transition to real-world development projects, applying their refined skills to boost both effectiveness and accuracy in project delivery.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-wp-embed is-provider-artena-technologies wp-block-embed-artena-technologies\"><div class=\"wp-block-embed__wrapper\">\n<blockquote class=\"wp-embedded-content\" data-secret=\"ubDzVniOXb\"><a href=\"https:\/\/artenatech.com\/index.php\/dream-team-agent-environment-for-real-world-product-development\/\">Dream Team &#8211; agent environment for real-world product development<\/a><\/blockquote><iframe loading=\"lazy\" class=\"wp-embedded-content\" sandbox=\"allow-scripts\" security=\"restricted\" style=\"position: absolute; visibility: hidden;\" title=\"&#8220;Dream Team &#8211; agent environment for real-world product development&#8221; &#8212; ArteNa Technologies\" src=\"https:\/\/artenatech.com\/index.php\/dream-team-agent-environment-for-real-world-product-development\/embed\/#?secret=Lsv5jAn5zF#?secret=ubDzVniOXb\" data-secret=\"ubDzVniOXb\" width=\"500\" height=\"282\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\"><\/iframe>\n<\/div><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>KoboldIJ &#8211; LLM Integration plugin for IDE Intellij Idea The KoboldIJ plugin for IntelliJ IDEA provides seamless integration with a locally hosted Large Language Model (LLM) powered by the KoboldAI (Koboldcpp) environment. This allows developers to make fast, secure, and free LLM requests directly from their development environment without relying on external APIs or public [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":33,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-31","page","type-page","status-publish","has-post-thumbnail","hentry"],"_links":{"self":[{"href":"https:\/\/artenatech.com\/index.php\/wp-json\/wp\/v2\/pages\/31","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/artenatech.com\/index.php\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/artenatech.com\/index.php\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/artenatech.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/artenatech.com\/index.php\/wp-json\/wp\/v2\/comments?post=31"}],"version-history":[{"count":35,"href":"https:\/\/artenatech.com\/index.php\/wp-json\/wp\/v2\/pages\/31\/revisions"}],"predecessor-version":[{"id":203,"href":"https:\/\/artenatech.com\/index.php\/wp-json\/wp\/v2\/pages\/31\/revisions\/203"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/artenatech.com\/index.php\/wp-json\/wp\/v2\/media\/33"}],"wp:attachment":[{"href":"https:\/\/artenatech.com\/index.php\/wp-json\/wp\/v2\/media?parent=31"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}