I’m building an instruct dataset but I’m not sure if I should replace some with general conversation instructions.

What’s the consensus right now on the best ratio of data? I saw Lima even had r/writingprompt in there.

Basically, how do you guys structure your data when fine tuning and what do you add other then the basic instruct data. Ratio of code questions seems to be important as well.

The amount in the different datasets is all over the place too, what do you guys aim for?