Back to Browse

Work with large CSV files by chunking the files into smaller files | Python Tutorial

31.7K views
Nov 6, 2018
5:20

Buy Me a Coffee? https://www.paypal.me/jiejenn/5 Your donation will help me to continue to make more tutorial videos! If you ever work with large data file (csv, JSON, or txt files), you know it is a pain to deal with such files. For one, most of the tools doesn't have the memory bandwidth to handle such file size. And you are running into system crash if you make a mistake. In this video I am going to show you an example how you can use pandas Read_CSV method to chunk a csv file into smaller files so you can load them easily. Link to Python script https://github.com/DataSolveProblems/Python-Examples/blob/master/chunkFile.py Visit my website https://LearnDataAnalysis.org #PythonTutorial #PythonScripts #PythonProgramming

Download

0 formats

No download links available.

Work with large CSV files by chunking the files into smaller files | Python Tutorial | NatokHD