How to loop through a CSV with multiple lines to grab 2 variables?

Question

I have a CSV file that contains usernames and passwords. The file looks something like this:

user1,password1 user2,password2 user3,password3 

I need to loop through each line to grab the username and password, use those variables, and then grab the next set of usernames and passwords, replace the content of the variables with the new ones, etc.

I've been searching for the best way to do this, but I'm not very familiar scripting and I'm getting lost. I've used awk to grab both individually, but I'm struggling to figure out how to use awk within a while loop. And I'm reading that might not be a great approach.

Answer 1

I don't see any need for awk here:

#!/bin/bash while IFS=, read -r user pass; do # something with "$user" "$pass" done < path/to/file.csv 

Answer 2

Assuming you have some pretty good passwords:

user1,",3 ""e`$^~´" user2,""")& Eu`id`" user3,ThisIsAlsoAGoodPasswordBecauseItIsLong 

Then you need something that can parse CSV ("" inside " is a ").

cat user+password.csv | parallel --csv do_stuff {1} {2} 

Answer 3

If the file is a proper CSV file, you can use ksh93 instead of bash which has support for parsing CSVs:

#! /usr/bin/env ksh93 while IFS=, read -rS user password; do something with "$user" and "$password" done 

On an input like

user,"a""b c,d" 

That would correctly set $user to user and $password to a"b<LF>c,d.