The actual shift in each row. This value will be modified by the sign extension routine used when folding in a sign bit from another row
final rowShift = <int>[];