48 questions
0
votes
1
answer
79
views
How to parse a field which has a variable length?
Can SoftCircuit CsvParser parse a variable length column in an otherwise fixed length file?
I can configure either fixed width or delimited rows, but I haven't figured out how to handle a hybrid.
I've ...
- 21
0
votes
1
answer
86
views
Sequence expressions with use statements inside
I used this answer https://stackoverflow.com/a/49672348/832783 to parse a csv file.
Here is the code:
open Microsoft.VisualBasic.FileIO
open System.Text
let parseCsv (fileName: string) (encoding: ...
- 4,057
1
vote
1
answer
275
views
Read from nth row in csv typescript
I am trying to read a csv file from 4th row, in my csv file first 3 rows contains some meta data in column1. But the actual number of columns in csv is 6.
eg:
metadata1
metadata2
metadata3
head01,...
- 127
-2
votes
1
answer
203
views
PHP CSV parser for 15000 rows optimization
I need to parse some CSV data and store it to the database. The input file is about 15000 rows. It is written in Laravel framewrok. The request to DB spend about 0.2s so it seems the problem is in CSV ...
- 4,413
0
votes
2
answers
95
views
Reading .csv data with inconsistent pattern
I have a very huge CSV file. I want to read it through Pyspark but I am not able to read it properly.
Sample csv as
"keyvalue","rto","state","maker_model","...
- 55
-4
votes
1
answer
61
views
Is the first key of a csv table necessarily between quotes and therefore inaccessible?
I have a react project with nodejs mongodb and I use csvparser to transform data from a csv table into data in my database, I noticed that the first key of my table is necessarily between coast for ...
0
votes
0
answers
65
views
Parse CSV using database and fieldFilter parameters
I created a method using an ArrayList that is building a list from a CSV File. I am having trouble adding the String value of the field to the list. When I tried to use field.add() it gives me an ...
1
vote
2
answers
63
views
converting csv into json not working as planned in node.js
hi i have this csv file and i want to make it json so i can access data easily in node.js i use the csv-parser module and insted of returning an json/object like file it just returns a big string
'...
- 31
0
votes
0
answers
390
views
How to read a huge CSV file efficiently and convert CSV values into objects based on a user-defined class in Java
I have to read a large CSV file with about 700,000 records and compare the CSV data to an API response. I was able to use OpenCSV and make the code work. However, the deserialization process is ...
- 83
1
vote
0
answers
198
views
How to take row header from CSV file
Okay so i have to read data from an CSV file and add methods that calculate which is seen in my code below, so my question is how can i put in output the header of a row (example first,second or third)...
- 11
0
votes
1
answer
4k
views
csv-parser, delimiter usage
There is a csv file separated by semicolons.
The problem is solved when I replace all semicolons in the file with commas. but I want it to parse the csv file with semicolon.
const csv = require('csv-...
- 3
1
vote
0
answers
331
views
How to parse a huge CSV batch by batch using node
I have a CSV file with 8Mil records and want to read the CSV without loading the data into memory and parse it to an API after some data manipulation. So can anyone help me, who do I parse the data in ...
0
votes
2
answers
2k
views
csv-parser .on('end') nodeJS
I have this function bd() that should return an arrays of all the data read in the file groupes.csv which will be later processed :
function bd() {
const birthdays = [];
fs.createReadStream('...
1
vote
2
answers
4k
views
Parse csv using "csv-parser" node JS
I am using the 'csv-parser' library.
Using the method below I am able to get the data stored in the birthdays array shown in the console:
const birthdays = [];
fs.createReadStream('./data/...
0
votes
0
answers
2k
views
Axios stream does not 'await' when I process line by line
I need to read a csv file from an external location. Then I need to parse each line and insert them one by one in the DB.
Once all is done, I need to do some other DB operations so I need to wait for ...
- 91
2
votes
1
answer
4k
views
Library to parse CSV files, that is compatible with Angular 13+ [closed]
I am making an Angular 13 project to parse CSV files but I am unable to find a package to parse the CSV Files, the ones I found by googling like "ngx-csv-parser" are not compatible with ...
- 103
1
vote
1
answer
1k
views
How to load values from a local csv and pass them in a webform using Playwright
So I am trying to automate the process of filling out a webform on https://www.business.att.com/disconnects/.
I am using the Playwright test tool to automate this process using JavaScript
I have the ...
- 11
2
votes
1
answer
787
views
Angular - Efficient way to parse 10000 rows of csv/tsv file
I'm looking for a more sufficient way (or lib) to parse csv/tsv that contains around 5000 ~ 10000 rows (using it to render a table with cdk virtual scroll for previewing the file). My current ...
- 2,997
1
vote
1
answer
1k
views
csv-parser cannot read or open such .csv file
csv file is
and in my index.js
here is my code :
const fs = require('fs');
const csv = require('csv-parser');
const inputFile = "./data.csv"
let results = []
fs.createReadStream(...
- 111
0
votes
1
answer
965
views
How to parse CSV correctly for Puppeteer to fill strings from CSV lines to text input on website?
I am trying to learn js/puppeteer and by building a simple web scraper to scrape books info for educational purposes. I am trying to get the web scraper to fill UPC numbers from a CSV file onto the ...
- 87
3
votes
1
answer
1k
views
How to read a CSV file, filter by a particular record and store it in different java object based on the records
I have a CSV file like below
Rahul|S|74|72|71
Randy|T|20000|2
Abinav|T|30000|3
Amrit|S|82|81|80
The above csv has information about both student's and teacher's of a school.
With the help of 2nd ...
- 499
0
votes
0
answers
632
views
Stop a readable stream when on data finds condition
I got a csv buffer that I am sending to a function.
In the buffer I got this data:
name,age
tom,33
pal,22
tim,60
jon,12
I use a node stream that pipes it to an object with csv-parser and as I go I ...
- 2,678
0
votes
0
answers
244
views
How to take not valid lines from csv-file?
I use TinyCsvParser as tool to map lines from large csv-file into my data models.
So, the question is how I can take not a valid lines to display it for user? Now it works with Regex, but I gonna re-...
- 103
2
votes
1
answer
624
views
Adding fast random access in reading and parsing file using csv-parse and node
I was using the csv-parser library to handle csv parsing in node. The file can be huge ranging from 50,000 to 500,000 lines, maybe even larger. I had to perform some computations on the csv, after ...
- 39