We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent e735e4e commit 64e6a98Copy full SHA for 64e6a98
webmagic-core/src/main/java/us/codecraft/webmagic/scheduler/QueueScheduler.java
@@ -4,12 +4,17 @@
4
import java.util.concurrent.LinkedBlockingQueue;
5
6
import us.codecraft.webmagic.Request;
7
+import us.codecraft.webmagic.Site;
8
import us.codecraft.webmagic.Task;
9
10
/**
11
* Basic Scheduler implementation.<br>
12
* Store urls to fetch in LinkedBlockingQueue and remove duplicate urls by HashMap.
13
*
14
+ * Note: if you use this {@link QueueScheduler}
15
+ * with {@link Site#getCycleRetryTimes()} enabled, you may encountered dead-lock
16
+ * when the queue is full.
17
+ *
18
* @author code4crafter@gmail.com <br>
19
* @since 0.1.0
20
*/
0 commit comments