SparkStreaming task, just starting to do not have what problem batch processing time is within a few hundred milliseconds, then probably last a few days after the restart (every are) program is to walk, walk slowly slowly and then I opened the sparkUI interface as shown in figure a heap of Active Batches
Is that the job processing time is 40 s so program walk slowly, some open to see the task this task left 40 s,
Then let the villa the next log, also didn't see what the ERROR doesn't even have a WARN, I am very confusing, may be two kinds of problem 1. There is something wrong with the configuration of resources (2) data skew which tilt, but can't find
Stick a startup script again