Yes, 55 ohm headphones are well below the threshold of where the Crack will operate properly.
You could add a feedback loop to the amp to force it to produce more power into your 55 ohm headphones with less noise, but there are some sonic consequences to this modification.
The output stage of the Crack amplifier offers a lot of current gain. Considering the equation for Power in terms of Current and Resistance: (I^2)*R, when we keep I fixed, the power output drops substantially when R is decreased, requiring all the oomph that the amp has to give, which also raises the noise floor.
I'd recommend staying above 100 ohms if at all possible.
-PB