Skip to content

Actionary Research

Market defining research to power your decision making and inform your strategy.

Research Series: AI Need To Know

← Back to Research
    • Best Practice Research
    • Chief Innovation Officers
    • Chief Technology Officers

    Don’t Drift Away from Reality — Ensure Vendors Offer AI Model Longevity

    • July 30th, 2024
    • Simon Harrison
    • 5 min read
    By Simon Harrison
    Analyst and Client Executive Partner

    Simon is an industry analyst who has authored over 30 Gartner Magic Quadrant notes as lead and with colleagues. He’s written important research as the Chief of Research advisor for Gartner. He continues to provide deep research and insights as an Executive Partner for Actionary clients and the industry.

    Summary

    In the ever-evolving landscape of machine learning (ML), winning the battle against model drift and decay is pivotal to maintaining a competitive edge and achieving sustainable success. Model drift and decay refer to the degradation in the performance of machine learning models that happens over time. This research delves into the critical importance of addressing these issues head-on and offers actionable insights to support verifying investment in the right Artificial Intelligence (AI) vendor solutions. Continuous monitoring, implementing automated retraining pipelines, and ensuring robust data management safeguard the integrity of AI systems and unlocks their full potential. Discover how proactive measures can ensure long-term value for your organization and what to be asking AI solution providers.

    Key Take: Effective management of model drift and decay is essential for sustaining the value of ML systems. Without these measures, models can become obsolete, leading to inaccurate predictions and reduced ROI.

    • Best Practice Research
    • Chief Innovation Officers
    • Chief Technology Officers

    Maximize AI With Clear Understanding of Fine-Tuning vs. Retrieval-Augmented Generation (RAG)

    • May 30th, 2024
    • Simon Harrison
    • 5 min read
    By Simon Harrison
    Analyst and Client Executive Partner

    Simon is an industry analyst who has authored over 30 Gartner Magic Quadrant notes as lead and with colleagues. He’s written important research as the Chief of Research advisor for Gartner. He continues to provide deep research and insights as an Executive Partner for Actionary clients and the industry.

    By Simon Harrison

    Summary

    Fine-Tuning and RAG (Retrieval-Augmented Generation) are essential AI model enhancement methods, each offering distinct advantages and challenges. Implementing these approaches strategically, based on specific AI application needs, can significantly enhance the performance and outcomes of pre-trained models. Conversely, choosing the wrong approach can undermine the benefits of an AI solution. This research explores the benefits of both Fine-Tuning and RAG, emphasizing the importance of selecting and combining these methods appropriately to achieve optimal results.

    Key Take: Companies that fail to align Fine-Tuning and RAG with the appropriate use cases will encounter inefficiencies, diminished performance, and missed opportunities to fully leverage AI’s potential.