Questions tagged [checksum]
The checksum tag has no summary.
173 questions
1
vote
1
answer
80
views
How to calculate the checksum of a ext4 (eg. superblock or inode)
I have an image-file of an ext4 file system (filesystem.img). I am extracting sections sections of the filsystem. Is there a way to manually calculate the the checksum of the sections just with a ...
- 11
0
votes
2
answers
233
views
sha256checksum - how to compare local file with checksum of the remote original
I have a local file file1 as well as the sha256 checksum of the original file.
The remote is a rhel8 server, local tool sha256sum inside of a git bash on a Windows10 Laptop.
For the love of god I seem ...
- 287
1
vote
2
answers
583
views
accelerate re-syncing for a large file (> 3 TB) with rsync
How to accelerate re-syncing large file (>3 TB) which got few of its blocks changed (< 1 GB) with rsync.
AFAIK, rsync will do checksum comparison between src/dst blocks to find the differences ...
- 111
0
votes
1
answer
224
views
How are EXT4 metadata checksums within group descriptors calculated?
I'm looking at parsing raw EXT4-formatted block devices, just using Python, primarily as a learning exercise, but am having trouble manually generating the expected Group Descriptor checksums - there ...
- 129
0
votes
1
answer
199
views
in AUR checksum is checksum of what?
In arch linux AUR there is a checksum field. It is easy to calculate checksum of files or archived directories. The thing I cannot find on internet is this AUR checksum is checksum of what?
1
vote
1
answer
115
views
Check SHA256SUMS and exit non-zero on unexpected file (file not present in digest)
I'm trying to check the integrity of a set of downloaded files using sha256sum.
I cryptographically signed a digest file (named SHA256SUMS) with PGP. I create the file by recursively calculating the ...
- 392
0
votes
0
answers
147
views
BASH Get input from STDIN while using | (pipe)
I'm creating a new script. I would like to implement a way to verify this script. So I'm using those commands to check the content of the file.
remote_file="$(curl -m2 -s "$1")"
...
- 131
1
vote
1
answer
93
views
See if any of a number of zip files contains any of the original files in a directory structure
I have a pretty hard problem here.
I have a photo library with a lot of photos in it in various folders.
I then started using Google Photos for my photos, I put those originals into Google Photos, and ...
- 171
0
votes
1
answer
711
views
gnome-software Unable to get list of updates: Failed to update metadata for lvfs: checksum failure
I sometimes use gnome-software to check for updates on Debian. My repositories are Debian Stable, Flathub and a few others each dedicated to a single program. When I do sudo apt-get update on Terminal ...
- 1
3
votes
1
answer
2k
views
How to determine which checksum `rsync` uses by default?
In the rsync image of output below:
I am unable to find the default checksum. Is it the first one,
or the one in brackets?
What is the bit-depth of just xxhash?
Found this DOCUMENTATION states the ...
- 99
4
votes
1
answer
453
views
Checksumming on Ext4 (crc32c-intel) while formatting (5TB external HDD)
I bought a new 2.5-inch external hard drive of 5TB in size from Seagate.
On my Linux Mint 21.1 now, I need to format the newly created partition with gdisk:
Model: Expansion HDD
Sector size (...
- 31.3k
2
votes
2
answers
633
views
does rsync calculate a checksum even when it won't be transferring any data?
From man rsync:
--existing
skip creating new files on receiver
(emphasis mine)
So, what I've done with apparent success:
rsync --existing -rtvhP "remote.machine:/photos/*" /photos
This ...
- 61
1
vote
1
answer
548
views
rsync not detecting changed file with option --append-verify
I have invoked rsync with the options --checksum and --append-verify.
My understanding of the processing for this combination of options has been that the application would behave as in the ...
- 340
1
vote
1
answer
3k
views
How to verify the downloaded files by .torrent?
Many Ubuntu versions like 18.04.1, 18.04.2, 16.04.3, kubuntu, lubuntu, xubuntu, couldn't find it's checksum of .iso file from websites, but the .iso can be downloaded from a torrent file providers ...
- 105
0
votes
1
answer
285
views
Looking for a checksum-based, poor-man's solution to fighting silent data corruption in long term storage of family video files
Secure storage of my collection of family video is becoming problematic after a dramatic increase in size in the last years. I am using a set of 3 copies of the same collection stored in 2.5 USB thin ...
- 1,117
0
votes
1
answer
566
views
How can I create a checksum for a folder full of files that I am copying to another hard disk to verify it?
I am on a 2015 MacBook Pro and have just updated to OS 12.01 Monterey, and to zsh on terminal.
I am able to create a checksum for individual files using
shasum -a 256 (then drag in a file).
However, I ...
16
votes
1
answer
3k
views
Splitting a small file into 512 byte segments changes it, but splitting it in 1k segments doesn't
So I'm trying to split a 64MB file FileCarve.001 into 512 byte segments (each block is 512 bytes long). I need to make sure the file has the same data when split into smaller files, so I cat all the ...
- 171
1
vote
0
answers
700
views
Checksum or validate .tar file contents with directory in shell
Scenario:
Using Linux shell to back up a directory of many sub files and compressing the data with ‘tar -cvpJf filename.tar /savedir/’.
Goal:
Using shell — checksum or validate the newly created ‘.tar’...
- 11
1
vote
0
answers
711
views
can md5sum check ignore some warnings?
When I run md5sum -c I get errors such as "No such file or directory". I only want checksum that did not match and ignore files that could not be read. --quiet gives me same result.
- 21
1
vote
1
answer
278
views
Make sure two folders are identical on compressed zfs and ext4
Summary
I have copied (rsync --archive) a folder from an ext4 filesystem to a zfs file system with compression on. Now, I'm trying to verify that both folders are identical so that I can safely delete ...
- 251
2
votes
2
answers
1k
views
How to rename a file to its creation date and hash value combined in order to achieve unique filename?
I have bunch of .JPG, .NEF and .MOV files made with my Nikon DSLR, named as DSC_0001.JPG, DSC_0002.JPG and so on. After certain number is reached, new directory is made and number count restarted, ...
- 361
15
votes
5
answers
14k
views
Why doesn't changing a file's name change its checksum?
As far as I know changing even a bit of a file, will change the whole checksum result, but when I change a file's name this does not affect its checksum (I've tried SHA-1, SHA-256 and MD5).
Why? file ...
- 893
0
votes
1
answer
339
views
Check installed packages + check effective deployement of packages [to detect problems caused by memory corruption]
My computer has a flawed memory stick for two years and I can't correct this (sticks aren't removable and computer cannot be changed : so it won't be the subject).
Sometimes a content is corrupted ...
- 2,467
0
votes
0
answers
58
views
how to check if someone override a directory?
Lets say i have an existing directory and someone did cp -r over this and some files changed. I want to detect this change. How can i do it ?
I thought of using md5 or some checksum calculator for ...
2
votes
0
answers
134
views
Is the output of `zfs send` deterministic?
My goal is to generate a single checksum for the entirety of a ZFS snapshot.
If zfs send is deterministic (including across systems, meaning including on the system that receives the snapshot), then ...
- 1,881