First, we realized that if we group logs by similarity and do the approval in batches, the process will significantly speed up. That was our fast and dirty solution. Then on top of it, we applied machine learning classification techniques to pre-classify these batches, so the approval itself became much faster. Finally, we developed a convenient user interface for manual approvers. The result was an almost ten-fold faster workflow.