Skip to main content
1,720 questions
Newest Active Bountied Unanswered
Filter by
Sorted by
Tagged with
0 votes
1 answer
137 views

I have a python generator that yields a sample (np.ndarray, size: batchsize x ndim) of a larger dataset (np.ndarray, size: ndata x ndim). I coded a decorator that yields a processed output (dict) of ...
Krill TheWzrd's user avatar
  • 9
0 votes
2 answers
93 views

I'm trying to crop a BMP image and draw it inside an HTML canvas then draw some lines on it. The problem is that the canvas does not draw the image but it draws the lines. The image: Let's take this ...
Damien's user avatar
  • 11
2 votes
1 answer
104 views

I want to create a large file(>200GB) and store it in Min.IO store. I deploy my attempts in a web app on a Kubernetes pod. One attempt was with a modified Redeable stream and csv-writter library ...
Emmanuel_Arreola's user avatar
  • 33
0 votes
0 answers
96 views

I am looking for the way how to compare two files (especially large files) in S3 within the same bucket using Java AWS SDK. I do not need to verify whole bucket if there are duplicates. As I ...
Bronek Kristal's user avatar
  • 1
0 votes
0 answers
58 views

I run software that outputs log files with several hundreds of thousands of lines, the files weigh 100MB+ Everytime I re-run the software, the log file opened in VSCode doesn't refresh unless I close ...
المهدي الطالب's user avatar
  • 1
-1 votes
1 answer
131 views

I have a task to fix/improve a program that we have and constantly throws OOM exceptions when processing large files (60-90Mb) in memory. This program essentially an in house solution to move files ...
George's user avatar
  • 2,212
0 votes
0 answers
66 views

I want to track a single .rtf file of 55 MB using this command: git lfs track "folderA/folderB/file.rtf" I've also tried adding in a --filename flag. After some time, the server errors out ...
BobDidley's user avatar
  • 211
0 votes
0 answers
97 views

I am new to GCP and I've developed a simple Google Cloud Run service that reads a CSV file from a Google Cloud Storage bucket and pushes each row to Pub/Sub. The code functions well on the emulator ...
SAUH's user avatar
  • 11
1 vote
0 answers
119 views

I work with large files and as a result of development I had to copy large files (about 10 gigabytes) in C code. In this regard, the question arose: how effective is the combination of map()+write() (...
complex's user avatar
  • 29
0 votes
0 answers
58 views

I need to get pdf files from s3 and return the same file to the frontend. def stream_pdf_from_s3(request, file_key): s3_client = boto3.client('s3') try: response = s3_client....
Azima's user avatar
  • 4,161
0 votes
1 answer
58 views

I want to begin by saying I have NOT programmed in many, many years, so sorry if this is a somewhat trivial question. My interest has been mathematics for the last couple of years Here's my code: ...
wyboo's user avatar
  • 791
-1 votes
1 answer
301 views

I'm working on an endpoint that queries a datasource and generates a large CSV file and streams it to the browser. I'm having an issue when the stream has sent ~2Gb through the stream this error is ...
cobolstinks's user avatar
  • 7,201
0 votes
0 answers
8 views

There is an error coming everytime i push my file on github. I tried changing the version of https from 2 to 1.1 , I have also tried to track files using git lf, I have also added these files to the ....
Vedica Gairola's user avatar
  • 23
0 votes
2 answers
270 views

I'm implementing a program which should get files from the user in Angular, send them to the node.js backend, where there those will be read and parsed into an array of object. I went with javascript ...
Andrea Fantini's user avatar
  • 1
0 votes
0 answers
51 views

I PHP fpt connection, I am trying to download one large file minimum 1GP from client server to my server but the downloading time taking minimum one-hour. But the server configuration and bandwidth ...
Raja N's user avatar
  • 19
2 votes
0 answers
81 views

I am looking for the best solution to upload large files to a MySQL database via an ASP.NET Core Web App using Entity Framework Core. I am looking at the Microsoft documentation *here, but I am ...
RyanO's user avatar
  • 51
0 votes
0 answers
66 views

I have a very large file of size approx. 5-10 GB. The file will have 2 types of lines: Lines starting with "#define CHAR_DEF" Lines starting with "% " Format of "% " ...
Ravi Patel's user avatar
  • 9
2 votes
1 answer
117 views

I have a 10GB csv file data/history_{date_to_be_searched}.csv. it has more than 27000 zip codes. On the basis of zip code I have to filter the csv file then each filtered file I have to upload to ...
zircon's user avatar
  • 930
0 votes
0 answers
92 views

I'm encountering difficulties processing large Excel files fetched from an SFTP server in my Rails application. The application comprises a Rails server and a Karafka server, and the application ...
user23353243's user avatar
  • 65
2 votes
1 answer
992 views

In my pre-windows days, i recall using a hex editor that only loaded in the part of the file i was working on. I need to load a file that is larger than available memory into visual studio to search ...
Barny's user avatar
  • 151
1 vote
1 answer
327 views

I have been working on making a multiplication table using a function, a for loop and string formatting. I tried a small-scale test table going up to twenty, which printed fine. then, I went all the ...
mechricson's user avatar
  • 117
0 votes
0 answers
42 views

I have access to a tape archival system on my network. The files stored on this system are quite large, about 700-800MB each, and accessing the system from Windows shows them marked "Archive.&...
AKS's user avatar
  • 89
1 vote
0 answers
232 views

I have a URL which is a 30GB of file, I want to create a Javascript function which will download the file in user system through chuncks by chunck (1GB). In simple term something like, 1GB of data ...
deepak vajpayee's user avatar
  • 21
1 vote
1 answer
572 views

In an university class, I need to work with a pretty big longitudinal data set: .rds-file is around 300mb, in total 380,000 observations of 5160 variables. The data set goes back to 1984, however I ...
Moritary 's user avatar
  • 31
-4 votes
2 answers
114 views

I have a couple of large files (~1Gb) of such structure: fooA iug9wa fooA lauie fooA nwgoieb fooB wilgb fooB rqgebepu fooB ifbqeiu ... fooN ibfiygb fooN yvsiy fooN aeviu I would like to replace in ...
MartynaM's user avatar
  • 1

1
2 3 4 5
…
35