{"id":6793,"date":"2025-12-16T16:52:45","date_gmt":"2025-12-16T14:52:45","guid":{"rendered":"https:\/\/eurocc-bulgaria.bg\/?p=6793"},"modified":"2026-10-23T10:16:38","modified_gmt":"2026-10-23T08:16:38","slug":"system-for-generative-ai-assisted-documents-and-reports-with-rich-visual-information-and-feedback-improvements-collaboration-with-industrial-end-users","status":"publish","type":"post","link":"https:\/\/eurocc-bulgaria.bg\/?p=6793","title":{"rendered":"System for Generative AI Assisted Documents and Reports with Rich Visual Information and Feedback Improvements (Collaboration with industrial (end) users)"},"content":{"rendered":"\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t
<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

NCC presenting the success story<\/strong><\/p>

NCC-Bulgaria has been founded by the Institute of Information and Communication Technologies at
the Bulgarian Academy of Sciences, Sofia University \u201cSt. Kliment Ohridski\u201d and the University of
National and World Economy.NCC-Bulgaria is focused on:<\/p>

  • Creating a roadmap for successful work in the field of HPC, big data analysis and AI,<\/li>
  • Analyzing the existing competencies and facilitating the use of HPC\/HPDA\/AI in Bulgaria<\/li>
  • Raising awareness and promoting HPC\/HPDA\/AI use in companies and the public sector.<\/li><\/ul>

    Scientific partners involved<\/span><\/b>:<\/span><\/b><\/b><\/p>

    Security Solutions Institute Ltd.<\/p><\/div>

    \"\"\"\"<\/span><\/div>
    \"\"<\/div>
    \u00a0<\/span><\/div>

    Technical\/scientific Challenge:<\/strong><\/p>

    The previous iteration of the platform successfully automated the generation of high-quality textual reports enriched with Python-generated, data-driven charts. The workflow dispatched user prompts to multiple LLMs, merged the outputs, performed quality assurance, and generated relevant visualizations in a secure sandbox. However, this established process faced new limitations. The final documents, while factually and grammatically sound, sometimes lacked a holistic, expert-level polish. There was no mechanism to check for strategic alignment between the text and visuals or to ensure the most persuasive narrative was presented. The workflow was linear, meaning any inconsistencies identified by a human reviewer required a manual restart of several steps. Furthermore, the platform was restricted to programmatic charts (matplotlib, graphviz), leaving a significant opportunity to incorporate more descriptive and engaging visuals like info graphics and conceptual diagrams.<\/p>

    Solutions: <\/strong><\/p>

    To address these challenges, the system was upgraded with a multi-agent, iterative refinement architecture. This new process introduces an AI-powered critical review step and a parallel visual generation stream.<\/p>

    • User-facing Web Interface \u2013 Enhanced Visual & Quality Options<\/u><\/strong><\/li><\/ul>

      The front-end was redesigned with an expanded \u201cVisual Options\u201d section and a new \u201cReview Options\u201d panel:<\/p>

      • Visual Generation Mode, the users can now choose between:<\/u><\/li>
      • Data-Driven Charts (Python code generation) \u2013 for precise, data-backed visualizations like bar, line, and heat maps.<\/li>
      • Illustrative Visuals (Generative AI) \u2013 for conceptual graphics, process flows, and infographics.<\/li>
      • Quality Control \u2013 a new option to enable a final \u201cAI Critical Review\u201d pass to enhance the coherence and impact of the final document.<\/li>
      • Back-end Pipeline \u2013 Dual-Stream Generation with Iterative Refinement<\/u><\/strong><\/li><\/ul>

        Initial Draft Generation<\/u><\/em><\/strong><\/p>

        The already used pipeline for prompt dispatch, text merging, and automated QA (Pass 1) remains the foundation.<\/p><\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t

        \n\t\t\t
        \n\t\t\t\t\t\t\t
        \n\t\t\t\t\t\t
        \n\t\t\t\t
        \n\t\t\t\t\t

        Dual-Stream Visual Generation<\/u><\/em><\/strong><\/p>

        After the initial text is finalized, the system initiates two parallel visual generation processes:<\/p>

        • Path A: Python Code Generator: The existing Semantic Visual Planner identifies data points and generates Python scripts for execution in the secure sandbox. This path continues to handle precise, data-driven charts.<\/li>
        • Path B: Infographics Generator: In parallel, a prompt is sent to a state-of-the-art multimodal model, Gemini Flash 2.5, to create illustrative visuals. This model is good at synthesizing information from the text to produce high-quality infographics, flowcharts, and custom diagrams that explain complex processes or concepts visually.<\/li><\/ul>

          First Draft Assembly<\/u><\/em><\/strong><\/p>

          The generated text and all visuals from both Path A and Path B are compiled into a single draft document.<\/p>

          State-of-the-art reasoning LLM as Critical Reviewer<\/u><\/em><\/strong><\/p>

          This is an important element of the new, improved workflow. The complete draft is submitted to a high-reasoning LLM (e.g., OpenAI o1\/o3 or Gemini 2.5 Pro) tasked with acting as an expert reviewer. This \u201cReviewer Agent\u201d assesses the document against the original user requirements for:<\/p>

          • Coherence: Does the narrative flow logically? Is there a consistent tone?<\/li>
          • Text-Visual Synergy: Do the charts and infographics effectively support the text? Could a different visual type be more impactful?<\/li>
          • Completeness: Are there any unsupported claims or missing explanations?<\/li>
          • Impact: Does the document effectively communicate its key message?<\/li><\/ul>

            The output is a structured JSON object containing specific, actionable feedback (e.g., {\u201caction\u201d: \u201creplace_chart\u201d, \u201cfigure_id\u201d: \u201cFIG_3\u201d, \u201csuggestion\u201d: \u201cReplace bar chart with a line chart to better show the trend over time.<\/em>\u201d}).<\/p>

            Iterative Refinement Loop<\/u><\/em><\/strong><\/p>

            The structured feedback from the Reviewer Agent triggers an automated revision cycle. The system routes the feedback to the appropriate module \u2013 be it the text generator for textual adjustments or the visual generators for recreating specific figures. This loop can run for a predefined number of iterations or until the Reviewer Agent approves the document, ensuring the final output is polished and aligned without human intervention.<\/p>

            Final Assembly<\/u><\/em><\/strong><\/p>

            The fully reviewed and refined text and visuals are assembled into the final document, complete with updated captions and accessibility text.<\/p>


            Scientific impact: <\/strong>\u00a0<\/p>

            • Demonstrates a multi-agent \u201cGenerator-Reviewer\u201d AI workflow \u2013 provides a practical implementation of an AI system where one set of agents generates content and another critically reviews and directs revisions, mimicking human collaboration.<\/li>
            • Showcases hybrid visual generation \u2013 establishes a novel, dual-stream approach that combines the precision of programmatic, code-generated charts with the creative power of direct-to-image synthesis for infographics.<\/li>
            • Establishes a model for automated iterative refinement \u2013 the feedback loop, driven by a reasoning LLM, introduces a scalable method for self-correction and quality enhancement in automated document creation, significantly raising the bar for machine-generated reports.<\/li><\/ul>

              Benefits:\u00a0<\/span><\/b><\/p>

              • The AI Critical Review step ensures the final reports are not just error-free but are also coherent, impactful, and aligned with the user goals.<\/li>
              • The ability to generate infographics and custom diagrams allows for new, more effective ways of visual storytelling, making complex information easier to understand.<\/li>
              • The automated refinement loop allows human experts to move from being editors to final approvers, so this would accelerate project delivery.<\/li>
              • By maintaining the sandboxed execution for Python and leveraging APIs for image generation, the system extends its capabilities without compromising on security.<\/li><\/ul><\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
                \n\t\t\t\t\t\t
                \n\t\t\t\t\t\t\t
                \n\t\t\t\t\t
                \n\t\t\t
                \n\t\t\t\t\t\t\t
                \n\t\t\t\t\t\t
                \n\t\t\t\t
                \n\t\t\t\t\t

                Success story # Highlights:<\/strong><\/p>

                • Introduces a \u201cCritical Reviewer\u201d step where a state-of-the-art reasoning LLM performs a holistic quality check on the entire document.<\/li>
                • Implements an automated feedback loop for iterative refinement, allowing the system to self-correct and improve text and visuals based on AI-generated suggestions.<\/li>
                • Adds a parallel, multimodal visual generation stream to create rich infographics and conceptual diagrams alongside data-driven charts.<\/li><\/ul><\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                  \n\t\t\t\t
                  \n\t\t\t\t\t

                  Figure 1: Sample output \u2013 part 1<\/strong><\/p><\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                  \n\t\t\t\t
                  \n\t\t\t\t\t
                  \n\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                  \n\t\t\t\t
                  \n\t\t\t\t\t

                  Figure 2: Sample output \u2013 part 2<\/strong><\/p><\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                  \n\t\t\t\t
                  \n\t\t\t\t\t
                  \n\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t
                  \n\t\t\t
                  \n\t\t\t\t\t\t\t
                  \n\t\t\t\t\t\t
                  \n\t\t\t\t
                  \n\t\t\t\t\t

                  Figure 3: An infographic, generated by Gemini Flash 2.5 as part of the document<\/strong><\/p><\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

                  \n\t\t\t\t
                  \n\t\t\t\t\t
                  \n\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
                  \n\t\t\t\t
                  \n\t\t\t\t\t


                  Contact:<\/strong><\/p>

                  • Venko Andonov, <\/strong>University of National and World Economy, Sofia, vandonov[at]unwe.bg<\/em><\/li>
                  • Valentin Kisimov<\/strong>, <\/strong>University of National and World Economy, Sofia, <\/em>vkisimov[at]unwe.bg<\/em><\/li><\/ul><\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"

                    NCC presenting the success story NCC-Bulgaria has been founded by the Institute of Information and Communication Technologies atthe Bulgarian Academy of Sciences, Sofia University \u201cSt. Kliment Ohridski\u201d and the University […]<\/p>\n","protected":false},"author":1,"featured_media":6794,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[129],"tags":[],"_links":{"self":[{"href":"https:\/\/eurocc-bulgaria.bg\/index.php?rest_route=\/wp\/v2\/posts\/6793"}],"collection":[{"href":"https:\/\/eurocc-bulgaria.bg\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/eurocc-bulgaria.bg\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/eurocc-bulgaria.bg\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/eurocc-bulgaria.bg\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=6793"}],"version-history":[{"count":7,"href":"https:\/\/eurocc-bulgaria.bg\/index.php?rest_route=\/wp\/v2\/posts\/6793\/revisions"}],"predecessor-version":[{"id":7633,"href":"https:\/\/eurocc-bulgaria.bg\/index.php?rest_route=\/wp\/v2\/posts\/6793\/revisions\/7633"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/eurocc-bulgaria.bg\/index.php?rest_route=\/wp\/v2\/media\/6794"}],"wp:attachment":[{"href":"https:\/\/eurocc-bulgaria.bg\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=6793"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/eurocc-bulgaria.bg\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=6793"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/eurocc-bulgaria.bg\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=6793"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}