90,418 questions
0
votes
0
answers
27
views
How to upload a time series CSV file to a Influxbd bucket
I have a Influx Bucket where I want to upload a predictions time series dataset for each id_number, the predictions for each goes 2 months in the future.
The thing is that everytime I try to upload it ...
- 15
0
votes
0
answers
89
views
FileNotFoundError when loading CSV with Pandas
This is the current code:
import pandas as pd
# Load your dataset (adjust the path as needed)
data = pd.read_csv('/Users/aditya/ID Tech Python Files/ID Lab Tech Correct 1/Science Fair/lib/creditcard....
3
votes
5
answers
123
views
I want to remove certain suffixes from particular columns in a tsv file
I have a .tsv file in which the 3rd and 14th columns contain IDs
These can be e.g. r_12 or d_5 or i_109 OR they can be r_58_0 r_58_1 r_74_0 etc.
I want to remove just the _0 and _1 endings so all the ...
- 39
1
vote
3
answers
137
views
Scraping the correct postcodes data in python
I have only been using python for a few months and I am trying to blend my hobby (skating all the london postcodes) with learning to code.
I found the following data
https://github.com/radiac/UK-...
0
votes
1
answer
105
views
Problem in converting the datatype of a column in PostgreSQL
I created a whole text table to avoid problems in the import of the csv. After that I changed the data cleanup to "," in "." as number dividers to avoid problems with the delimiter....
1
vote
1
answer
73
views
Problem with cleaning csv data before Importing in PostgreSQL
I started studying SQL a month ago. I'm trying to import a .CSV file but I have a problem.
In the that file, there are numbers written in quotes and where decimals are divided by commas.
In Excel, if ...
0
votes
1
answer
70
views
How to create multiple CSV files to avoid 10MB file content limit using map reduce script?
I hope you are welll. I am trying to store dataset results in a csv file. but I am getting error as, SSS_FILE_CONTENT_SIZE_EXCEEDED error. So my plan is to create multiple files. But, I need to check ...
- 121
1
vote
1
answer
62
views
Cannot index string with string "name" - CSV output from JSON
I'm trying to output data in a JSON file I have with a few thousand rows to CSV. The JSON components follow this general pattern:
{
"name": "pickles",
"aliases": [
...
- 13
0
votes
1
answer
400
views
Pandas read_excel() not reading all columns
I'm using Python 3.12.6 and pandas==2.2.3.
This is a simple code, that I've always used and always worked to read the first sheet of an excel file:
df = pd.read_excel(file_path, engine='openpyxl', ...
-4
votes
1
answer
192
views
Convert CSV to Parquet, golang
I need to convert csv file to parquet format using golang. It should be dynamic. I am new in golang, and i am not finding out how to fix this error i am receiving: Error finalizing Parquet file: ...
- 7
0
votes
3
answers
117
views
Control number of decimal points exported in write_csv
I must be missing something. There must be a way to have write_csv only export a column with 2 decimal points. For my use case, I could work with excel or csv or anything. But I need a file exported ...
- 2,001
1
vote
2
answers
78
views
Python Pandas Loc Columns Between 2 Dates
I am quite new to Pandas. I need to select/locate the records between 2 dates.
I have tried a range of methods, but cant seem to get it. I have included a cut down of sample of the CSV/Data I am ...
- 13
0
votes
0
answers
19
views
Why does importing/uploading Shopify updates reset variant images?
I have thousands of prices to update via CSV upload. I simply export the whole catalog, and change nothing except for the Variant Price column. I then upload this and it goes without a hitch.
But I ...
- 307
-3
votes
1
answer
103
views
How do I change the case using csv
It is necessary to change the case of the first column in the CSV file to lower case using the csv module by writing to the same file.
with open('D:\\folder\file1.csv', 'r') as file1_csv, open('D:\\...
1
vote
1
answer
45
views
Rename CSV Column Heading in Powershell Using Select-Object Not Working
I am working to process a raw CSV file given to my team via SFTP and update the format to the correct format for our system needs. I've been requested to script this via PowerShell so the script can ...
-2
votes
2
answers
103
views
CSV writer in 3.12 breaking file integrity due to special character constraints
Currently running into an issue in our Python 3.8 to 3.12 upgrade for our lambda function. For context, the Lambda exports to a csv file, and includes a column called metadata that contains raw JSON. ...
0
votes
0
answers
57
views
Converting a Credentialset into CSV details for importing into a Database
I have a lot of files containing credentials in the format of
[email protected]:password
[email protected]:password2
my desired Outcome would be a CSV file so I am able to load the data into a Database
...
- 1
1
vote
4
answers
355
views
Handling bad lines when reading csv files with pd.read_csv()
I am trying to parse some csv files with a few thousand rows. The csv is structured with comma as a delimiter and quotation marks enclosing each field. I want to use pd.read_csv() to parse the data ...
0
votes
1
answer
69
views
Query Multiple SQL Table Records and Transform into CSV
I have to get data from 2 tables and then merge them into a CSV file.
Table 1 has 50 columns, table 2 has 20 columns. I have 30k records in table 1 and 10k in table 2.
Code is working fine and takes 1 ...
- 1,285
0
votes
0
answers
44
views
Unable to launch `Import-Csv` and `Out-GridView` from within R [duplicate]
I want to launch Import-Csv and Out-GridView from within R. This code works when used in the Powershell command line:
Import-Csv "C:/Users/<path>/sample.csv" | Out-GridView
Based on ...
- 1,358
1
vote
2
answers
53
views
Powershell: formatted String(2Dim Array) to CSV
I have a function to return a json string in this format:
{"TownA":{"female":512,"male":468},"TownB":{"female":748,"male":845}}
I'd like to append the data to a CSV:
town, value, gender
TownA, ...
- 146
1
vote
4
answers
253
views
Using Python to replace triple double quotes with single double quote in CSV
I used the pandas library to manipulate the original data down to a simple 2 column csv file and rename it to a text file. The file has triple double quotes that I need replaced with single double ...
- 577
0
votes
1
answer
50
views
Write/ Read columns of list of numbers (integer or float) to/ from CSV in Python [duplicate]
My data consists of 4 columns.
They are Name, Age, Seq_1, Seq_2.
For a row (an instance) in my data, its Name and Age are in string and integer, respectively.
Seq_1 is an array of numbers. It can be ...
- 73
1
vote
1
answer
90
views
Errors with opening file when reading a .hdf file with Python
I have some data from NDACC that I want to read so that I can plot a graph. I've downloaded one file and named it groundbased_ftir.hdf. However, it just says that either the file doesn't exist, or ...
- 11
-1
votes
1
answer
94
views
How can decimal values be totalled in a Windows batch file for loop [closed]
I have been trying to read a comma delimited csv file and total a value from each record using the code below that I have put together from various searches:
@echo off
setlocal EnableDelayedExpansion
...
- 47