The standard IF filter is a narrow-band CW filter by design. SSB can be decoded by opening the bandwidth but the characteristics of the filter is poor for SSB and the opposite side band suppression is minimal.
An alternative filter is shown below which is designed specifically for decoding SSB voice signals.
New SSB Filter PCB
A new filter PCB that can be used for SSB or CW is currently being tested and will be released as soon as the design is proven.