Home > Net >  Using Python/Pandas to loop over several csv files in a folder and make changes to each csv file
Using Python/Pandas to loop over several csv files in a folder and make changes to each csv file

Time:01-29

I currently have several csv files in a folder. I am wanting to use Python to loop over the files in the folder and make small changes to each csv file. Please see my code below which is not currently working:

import os
import pandas as pd

folder_to_view = "C:/path"

for file in os.listdir(folder_to_view):

    df = pd.read_csv(file)

    df.columns = ['Location','Subscriber','Speed','IP','Start','End','Bytes','Test Status','Comment']

    df.to_csv(file, index=False)

CodePudding user response:

I imagine that the issue is not forming the path correctly as the renaming of columns should be fine. os.listdir() returns a list of the files within that directory without the directory name prepended, so try this:


import os
import pandas as pd

folder_to_view = "C:/path"

for file in os.listdir(folder_to_view):
    full_path = f'{folder_to_view}/{file}'
    df = pd.read_csv(full_path)
    df.columns = ['Location','Subscriber','Speed','IP','Start','End','Bytes','Test Status','Comment']
    df.to_csv(file, index=False)

  •  Tags:  
  • Related