Thanks for this, but some encoding types not working.

[vdruts]

I exported a csv from excel and getting this error; can you make encoding types more robust please?

UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc3 in position 7635: invalid continuation byte
Traceback:
File "C:\Users\xxxx\anaconda3\envs\csvai\lib\site-packages\streamlit\runtime\scriptrunner\script_runner.py", line 552, in _run_script
exec(code, module.dict)
File "C:\Users\xxxx\Deep\CSV-AI\app.py", line 274, in
main()
File "C:\Users\xxxx\Deep\CSV-AI\app.py", line 263, in main
summary(model_name=model_name, temperature=temperature, top_p=top_p, freq_penalty=freq_penalty)
File "C:\Users\xxxx\Deep\CSV-AI\app.py", line 124, in summary
data = loader.load()
File "C:\Users\xxxx\anaconda3\envs\csvai\lib\site-packages\langchain\document_loaders\csv_loader.py", line 51, in load
for i, row in enumerate(csv_reader):
File "C:\Users\xxxx\anaconda3\envs\csvai\lib\csv.py", line 111, in next
row = next(self.reader)
File "C:\Users\xxxx\anaconda3\envs\csvai\lib\codecs.py", line 322, in decode
(result, consumed) = self._buffer_decode(data, self.errors, final)

[Safiullah-Rahu]

Hi,

Try these two encodings to save excel file as csv,

1. CSV UTF-8 (Comma delimited) (*.csv)
2. CSV (Comma delimited) (*.csv)

Further this stackoverflow thread might help you: https://stackoverflow.com/questions/5552555/unicodedecodeerror-invalid-continuation-byte