Looking for suggestions
I have two JSON feeds from an app coming in from two nodes. I am trying to find the best way to:
- Combine the outputs into a single output. Maybe Merge node, but the header section is causing issues for me.
- Strip out some of the fields since they are not needed (or maybe keep only certain fields since there are fewer to keep)
- Format that big blob into something I can feed into the OpenAI API with instructions on what I want it to look for.
- To make it even more interesting, ideally I would have as many as 50 of these pairs that will need to be sent together as a group to be analyzed by OpenAI. They are all small file - 50 kbs at most usually.
Those are in no real order and if there is a better approach, I would gladly try it. I have the http requests set up and pulling in the data. I am stumped on the best way to handle the data.
TIA!