I have a folder full of ansi-encoded .txt files. All are less than 2MBytes. I am getting this error on upsert:
"PS C:\Users\gaopt\AppData\Local\canopy-env> canopy upsert E:\AICorpus\Text
Canopy is going to upsert data from E:\AICorpus\Text to index:
canopy–gcp-starter
Error: A unexpected error while loading the data from files in E:\AICorpus\Text. Please make sure the data is in valid jsonl
, parquet
, or csv
format, or plaintext .txt
files.
Your helpbot pointed me to read about the 2MByte file size limit and something about the number of zeros. Am I doing something wrong?