AI preprocessing: Extract text from JSON files and convert them into QA format CSV files
- name
- Extract text from JSON
- tag
- AI preprocessing/Claude/Generative AI
- Connector used
- REST Connector
- API
- API version: 2023-06-01
Dividing the input data used in RAG into questions and answers will lead to improved accuracy of the generative AI's answers.
This application loads a JSON file into Claude, an LLM, extracts text from the JSON file, and splits the content into questions and answers. The conversion results are output as a CSV file.
By using this application, you can efficiently prepare data, which is essential for generative AI, contributing to cost reduction and improved response quality.
Script Details
Convert JSON files to CSV files in QA format
JSON_To_QA_Claude_convert
Checking the limit value for the number of tokens required for JSON file conversion
JSON_To_QA_Claude_validate_limits
Output the text extraction results of a JSON file to a CSV file in QA format
JSON_To_QA_Claude_convert_to_csv
How to install and use it