6,100 questions
4
votes
2
answers
182
views
How to gzip a string to a file so that it can be unzipped with regular gzip?
I want to serialize R objects as JSON for other programs to use, and gzip them for efficient transport. So I run
data <- list(foo = "bar")
readr::write_file(jsonlite::as_gzjson_b64(data), ...
- 10.8k
2
votes
1
answer
170
views
Is there a portable, simple, way to compress/decompress gzip in C?
I am relatively new to C programming. I am trying to write a parser for the Minecraft NBT data format (specification by Notch on the Wayback Machine).
However, I am running into a problem.
An NBT file ...
- 356
0
votes
1
answer
91
views
How to get size of the file inside tar.gz [closed]
we have a file - file.tar.gz, currently we do following to check the content of the file.
use gunzip command to get the .tar file
use tar command to untar the file.
Now inside the tar file we have ....
- 887
0
votes
1
answer
58
views
Python save TemporaryFile read as "w+b" to compressed tarfile
I am given a SpooledTemporaryFile through FastAPI's UploadFile. My goal is to write it to disk so I can extract it and process its contents later. This seems simple, but I am having problems saving ...
- 45
0
votes
0
answers
53
views
Gzip files extraction
I am trying to extract .pkl files from the .zip files that are actually gzips. I have tried gunzip but it only works with .gzip extension.
I have tried the following but it gives me all the data (pkl,...
- 15
3
votes
1
answer
148
views
Reading through multiple files in chunks in R
I'm trying to read through multiple compressed tables that are 5GB+ in size in R, and because I have insufficient memory to read them into memory all at once I need to process them one chunk at a time,...
- 80
2
votes
1
answer
123
views
How do I generate gzip files with the optional CRC16 field?
I've written my own gzip decompressor which is fully compliant with RFC1951 (DEFLATE) and RFC1952 (gzip format), but I am struggling to test the optional CRC16 field present in the gzip header.
If the ...
- 119
1
vote
0
answers
34
views
Paritial records being read in Pyspark through Dataproc
I have a Google Dataproc job that reads a CSV file from Google Cloud Storage, containing the following headers
Content-type : application/octet-stream
Content-encoding : gzip
FileName: gs://...
- 383
0
votes
0
answers
57
views
GCP Cloud Storage only returns one line on decompressive transcoding
I upload gzip compressed files to a bucket on GCS. I set the metadata of the object as follows:
Content-Encoding: gzip
Content-Type: application/json
According to GCS documentation, this makes my ...
0
votes
1
answer
153
views
Gzip file uploaded to Azure Blob Storage, when downloaded to Windows machine does not open and the file size is not same
I am uploading a csv file with gzip encoded to Azure Blob Storage using C# .net 8. I am able to read the file ok when I download file and read data use .Net code.
But I have two problems.
When I ...
- 1,141
0
votes
1
answer
74
views
Java: GZIP file contains another GZIP file when saving logs in Windows
I'm working on a Spring Boot application where I need to download log files from a mock service and save them as GZIP files on a Windows system. However, I've encountered an issue where the saved .gz ...
- 99
4
votes
2
answers
1k
views
Chrome Devtools showing gzip response in HEX
For some reason Chrome devtools started to show requests with gzip content in a HEX editor view like on response tab. That's very annoying... is there a way to disable this view and show plain text/...
- 41
0
votes
0
answers
505
views
Package 'ros_gz_sim' not found: "package 'ros_gz_sim' not found, searching:
Good afternoon, Is there anyone who know how to solve this issue, when I try to launch a file with ros2 it says that the package is not found.
error in terminal
I've installed the package cloning the ...
2
votes
1
answer
111
views
What is LENGTHS CODE OVER error and why am i getting this?
I am working on an improved program that attempts to recover PKZIP keys with intention of CUDA support, So I integrated a decompression algorithm from infgen to decompress an array of bytes instead of ...
- 141
0
votes
1
answer
113
views
How can you verify two tar.gz files are identical
I am making a sharing protocol, and when you share a folder it gets tar.gz-ipped and inserted in a folder.
It's created like this:
with tarfile.open(full_data_name, "w:gz", format=GNU_FORMAT)...
- 2,969
-1
votes
1
answer
1k
views
Gzip compression not working in spring boot project
I am trying to implement gzip compression in my spring boot project(v2.7.12).
I have added below in application.properties file.
server:
compression:
enabled: true
min-response-...
- 5
0
votes
2
answers
115
views
How to read gzip file download from an API
I`m trying to download a file from an API that give me sales of a client. But I dont know how to do it.
url = URI("https://conciliation.stone.com.br/v1/merchant/{MYCODE}/conciliation-file/...
- 105
0
votes
0
answers
104
views
Getting from Gitlab the exact same archive I get from using "git archive"
I'm in my project's directory and have checked out tag 1.0. I've pushed this tag to Gitlab and made a release from that tag. I want to be able to do git archive --format=tgz --prefix myproject-1.0/ ...
- 612
0
votes
1
answer
30
views
Python: import module from gzip file
I have Python module 'common_types' in file: /path/common_types.py.gz
I want to import it in my script:
import common_types
I tried:
importlib.util.spec_from_file_location("common_types", ...
0
votes
1
answer
47
views
Trying to access a .gz file inside a .zip file through Python
I have a .zip file with a large amount of .gz files, which I need to process. I want to open the .zip, which I can easily do through this code:
zf = zipfile.ZipFile("file.zip", "r")...
- 123
1
vote
0
answers
61
views
Zip file is created successfully whenever I use os.Create() but when I try to send the Zip file via HTTP Response I get gibberish data in Postman resp
This is my code that generates a ZIP file on the fly and writes a pdf (fetched from AWS S3 bucket) inside the ZIP file. If I write the ZIP file to the disk via os.create there is no issues but if I ...
- 21
0
votes
1
answer
103
views
Raw gzip data contains non-ASCII characters
I am working with gzip raw data that contains non-ASCII characters that I am unable to decompress and decode.
I am getting the data from Firestore through the python client and the payload looks like:
...
- 11
0
votes
0
answers
61
views
Node.js gzip compression vs. tar -czf
I have a black-box system that I'm feeding .tgz files into. When those files are compressed with node compress.js path/to/folder/, the black box accepts the archive. When they're compressed via tar -...
- 195
0
votes
1
answer
159
views
Java client + Apache HTTP server + GZIP Compression/Decompression
I want to compress HTTP traffic via gzip content-encoding http header, both on requests and responses. I'm able to receive compressed data from the HTTP server and to decompress it, but if I try to ...
0
votes
1
answer
619
views
How to make WebClient in Spring Boot work with gzip?
I use WebClient to get some data from a remote server. The remote server is capable of dealing with gzip. In other words if I send a GET request with "Accept-Encoding: gzip" it returns ...
- 9,085