Module tokenize 

Tokenization of executables

Constants

STRING_TOKEN_MIN_LEN 🔒

WCHAR_STRING_TOKEN_MIN_LEN 🔒

Functions

tokenize_executable_file

Naively tokenize an executable file by parsing its data sections. This very much assumes the executable isn’t behaving badly and that strings in it are actually in the data section.

tokenize_src_file

tokenize_strings 🔒