How to iteratively sha256 in Python using native lib (ie hashlib), using byte[] as input and not hex string

Question

Background: I have an iterative hash algorithm I need to compute from a Python script and a Java web application.

Psuedo code:

hash = sha256(raw)
for x=1 to 64000 hash = sha256(hash)

where hash is a byte array of length 32, and not a hex string of length 64.

The reason I want to keep it in bytes is because, though Python can convert to hex string in between each iteration and keep the processing time under a second, Java takes 3 seconds for the String overhead.

So, the Java code looks like this:

// hash one time...
byte[] result = sha256(raw.getBytes("UTF-8"));

// then hash 64k-1 more times
for (int x = 0; x < 64000-1; x++) {
  result = sha256(result);
}

// hex encode and print result
StringBuilder sb = new StringBuilder();
Formatter formatter = new Formatter(sb);
for (int i=0; i<buf.length; i++) {
  formatter.format("%02x", buf[i]);
}
System.out.println(sb.toString());

And the Python code looks like this:

import hashlib

# hash 1 time...
hasher = hashlib.sha256()
hasher.update(raw)
digest = hasher.digest()

# then hash 64k-1 times
for x in range (0, 64000-1):
  # expect digest is bytes and not hex string
  hasher.update(digest) 
  digest = hasher.digest()
print digest.encode("hex")

The Python result calculated the hash on the hex representation of the first digest (String), rather than the raw digest bytes. So, I get varying outputs.

Michał Zieliński · Accepted Answer · 2012-04-19 19:24:46Z

6

Method .update of hasher appends argument to previous text (Python docs). Instead you should create new hasher each time you want to compute digest.

import hashlib

# hash 1 time...
digest = hashlib.sha256(raw).digest()

# then hash 64k-1 times
for x in range(0, 64000-1):
  digest = hashlib.sha256(digest).digest()
print digest.encode("hex")

answered Apr 19, 2012 at 19:24

Michał Zieliński

1,34511 silver badges13 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Robert Christian Over a year ago

Thanks Michal that solved it. I added a single line to the code to obtain a new hasher: hasher = hashlib.sha256(), as the first line within the for loop. What threw me is that Java resets the hash inputs after digest is called, and Python does not.

Robert Christian Over a year ago

... and now I see you did the same thing with less code. Thanks again.

Collectives™ on Stack Overflow

How to iteratively sha256 in Python using native lib (ie hashlib), using byte[] as input and not hex string

1 Answer 1

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related