Integrate Apache AGE into Prototype

Background

This issue started as an investigation into Apache AGE. See this comment for more details on the results of that research.

The remaining work for this issue is to integrate Apache AGE into the prototype to see how it works.

Objectives

  1. ✅ Conduct a time-boxed assessment of Apache AGE.
    1. Feel free to include aonther data store if we should assess 2 options in parallel.
  2. ✅ Provide an overview of benefits and tradeoffs.
  3. ✅ Create a summary (in this issue) to inform future decision-making.
  4. ➡️ Integrate Apache AGE into prototype

Original Deliverables

  1. ✅ A summary of benefits and tradeoffs. See this comment
  2. ✅ A comparison matrix highlighting key features and benefits of each option.
  3. ✅ A brief report with recommendations for further investigation, if necessary.

Remaining Tasks

These may need to be updated based on the integration process and how the development environment is set up

  1. Set up Apache AGE within the prototype environment.
  2. Modify the prototype to use Apache AGE instead of the current graph database solution.
  3. Migrate existing data structures and queries to work with Apache AGE.
  4. Perform thorough testing of the integration, including:
    • Functionality testing
    • Performance benchmarking
    • Scalability assessment
  5. Document any challenges, limitations, or benefits discovered during the integration process.
  6. Provide recommendations for full implementation based on the integration results.

Next Steps

After completing this integration and testing phase, we'll be better positioned to make a final decision on using Apache AGE for our knowledge graph implementation. This will inform our strategy for scaling the solution across our entire codebase.

Edited by Matt Nohr