I am clueless about what I am doing wrong. I tried to calibrate gyro and accelerometer in all six positions while keeping it still as much as I can, I cannot imagine that it can be more stable during calibration (fixed firm to bubble balance without holding by hands).
When I turn the controller on, it stabilizes the camera, but its neutral position is not leveled and it is drifting slowly along all three axis: