怎样使用快捷采集（以采集京东评论为例）

lzl0927 发表于 2024-1-23 22:30
就像图里这样，我输入了50个网址，进度显示50个采集完成，10个抓取出错，但打包的时候却只有7条，重采也 ...

我测试了你的第一个网址，采集成功。你把所有网址发出来我试试。不要发截图，发文本网址

谢谢您的答复

全部网址，一条放不下，分两条发了

无论是分批输，还是一起输，每次都要一半左右抓取出错。越重采，成功抓取的就越少，比如50个网址重采3次就剩7个。。。就这200多网址我抓了不下十遍。。。。

正常采集微博没问题，只有展开全文收集是这个情况。

有没有可能是网络不稳定导致的？我目前在英国。

https://weibo.com/1017915833/Me4mEzeNl?refer_flag=1001030103_

https://weibo.com/1021286870/MgIIb4hti?refer_flag=1001030103_

https://weibo.com/1076551400/Mlwb0zvSY?refer_flag=1001030103_

https://weibo.com/1157483411/MmKOJoks4?refer_flag=1001030103_

https://weibo.com/1162629521/M1lBBh2YM?refer_flag=1001030103_

https://weibo.com/1162629521/M2XuNCKbE?refer_flag=1001030103_

https://weibo.com/1249419685/MdhJc7r6w?refer_flag=1001030103_

https://weibo.com/1310442473/LDLqW0EBB?refer_flag=1001030103_

https://weibo.com/1310442473/LDLqY3Eym?refer_flag=1001030103_

https://weibo.com/1310442473/LDLqy4xEv?refer_flag=1001030103_

https://weibo.com/1310442473/LDLr0b1tp?refer_flag=1001030103_

https://weibo.com/1378201937/M2uEQFlPL?refer_flag=1001030103_

https://weibo.com/1558542650/LAejbl69E?refer_flag=1001030103_

https://weibo.com/1558542650/M0ETb44wz?refer_flag=1001030103_

https://weibo.com/1642634100/LDBvgkJrJ?refer_flag=1001030103_

https://weibo.com/1642634100/LDqtA1Tdz?refer_flag=1001030103_

https://weibo.com/1642720480/LDrTWFn4A?refer_flag=1001030103_

https://weibo.com/1642720480/M2oCG9ZtN?refer_flag=1001030103_

https://weibo.com/1644489953/LDszuvTXP?refer_flag=1001030103_

https://weibo.com/1646051850/LDr227tGI?refer_flag=1001030103_

https://weibo.com/1646051850/LDv6hldfu?refer_flag=1001030103_

https://weibo.com/1648254924/MgXy0oq0m?refer_flag=1001030103_

https://weibo.com/1648254924/Mh0Y97MDe?refer_flag=1001030103_

https://weibo.com/1648254924/Mh8QPDIb7?refer_flag=1001030103_

https://weibo.com/1649173367/LDr2spgXu?refer_flag=1001030103_

https://weibo.com/1659280190/LDswXEMIW?refer_flag=1001030103_

https://weibo.com/1659643027/LCS4qvBCT?refer_flag=1001030103_

https://weibo.com/1659643027/LDFo96pbE?refer_flag=1001030103_

https://weibo.com/1704544512/LDvrYFlWa?refer_flag=1001030103_

https://weibo.com/1712686623/LDr7qEm18?refer_flag=1001030103_

https://weibo.com/1715845153/MkLiTmKlJ?refer_flag=1001030103_

https://weibo.com/1718259005/LDtIOzisy?refer_flag=1001030103_

https://weibo.com/1744259092/LDr7sE2ji?refer_flag=1001030103_

https://weibo.com/1746692527/LDmdJfrkf?refer_flag=1001030103_

https://weibo.com/1747383115/LD802nqQh?refer_flag=1001030103_

https://weibo.com/1750070171/Mn6s4Fafc?refer_flag=1001030103_

https://weibo.com/1750355192/LDtsblAmu?refer_flag=1001030103_

https://weibo.com/1769228100/LDqJbtfaJ?refer_flag=1001030103_

https://weibo.com/1771650130/LDmkJ2tWs?refer_flag=1001030103_

https://weibo.com/1772293130/LDtHSAY49?refer_flag=1001030103_

https://weibo.com/1787526981/LDrkMkUrw?refer_flag=1001030103_

https://weibo.com/1793254175/LDrpBCyvQ?refer_flag=1001030103_

https://weibo.com/1801487174/LDt1JjqL7?refer_flag=1001030103_

https://weibo.com/1802003777/M611fBZtc?refer_flag=1001030103_

https://weibo.com/1826017320/LCSLvw66o?refer_flag=1001030103_

https://weibo.com/1829261987/LDrhViIfj?refer_flag=1001030103_

https://weibo.com/1856404484/M19w8z3Lg?refer_flag=1001030103_

https://weibo.com/1861371044/M04YcbJye?refer_flag=1001030103_

https://weibo.com/1868493055/MjPW87CYP?refer_flag=1001030103_

https://weibo.com/1890044880/M2oFWCUGC?refer_flag=1001030103_

https://weibo.com/1895096900/LDrkFx1P3?refer_flag=1001030103_

https://weibo.com/1899198043/LDrDShA7U?refer_flag=1001030103_

https://weibo.com/1902094523/Mf6It2NCE?refer_flag=1001030103_

https://weibo.com/1910019822/LDreapAhs?refer_flag=1001030103_

https://weibo.com/1918149512/LDr1Sk5gs?refer_flag=1001030103_

https://weibo.com/1920247930/LDreJhJMA?refer_flag=1001030103_

https://weibo.com/1974561081/LDr8udcpy?refer_flag=1001030103_

https://weibo.com/2097129181/MePtMkFXy?refer_flag=1001030103_

https://weibo.com/2099539611/LDqv9dIvW?refer_flag=1001030103_

https://weibo.com/2111153330/MgSEffx3r?refer_flag=1001030103_

https://weibo.com/2116819542/LDrrSAF62?refer_flag=1001030103_

https://weibo.com/2133179511/LFD45rHgS?refer_flag=1001030103_

https://weibo.com/2186249143/LDlz48ja4?refer_flag=1001030103_

https://weibo.com/2245266941/LDqYCz8pH?refer_flag=1001030103_

https://weibo.com/2270313735/MlXeu1KtI?refer_flag=1001030103_

https://weibo.com/2273500281/MhnKNeYC3?refer_flag=1001030103_

https://weibo.com/2279005083/MgRLwrhp9?refer_flag=1001030103_

https://weibo.com/2284141363/LDrqY8jxT?refer_flag=1001030103_

https://weibo.com/2289091401/Mgl8LqbYS?refer_flag=1001030103_

https://weibo.com/2292402474/LDr8mdnZb?refer_flag=1001030103_

https://weibo.com/2296822091/LF0RdtJT7?refer_flag=1001030103_

https://weibo.com/2298836177/MdX83Esze?refer_flag=1001030103_

https://weibo.com/2310684991/M8A385Lw2?refer_flag=1001030103_

https://weibo.com/2313023795/MewANoqfz?refer_flag=1001030103_

https://weibo.com/2375282231/McBdMfVMz?refer_flag=1001030103_

https://weibo.com/2377587254/LDrbhoPEF?refer_flag=1001030103_

https://weibo.com/2478386590/M3t8ovphz?refer_flag=1001030103_

https://weibo.com/2618638282/LDm96BDIL?refer_flag=1001030103_

https://weibo.com/2624347394/Mcioxip3W?refer_flag=1001030103_

https://weibo.com/2648293003/MkBXM6hTY?refer_flag=1001030103_

https://weibo.com/2665749913/LDqJfiHDA?refer_flag=1001030103_

https://weibo.com/2672602304/Mj0hXgFSy?refer_flag=1001030103_

https://weibo.com/2735547937/M1w57d5X0?refer_flag=1001030103_

https://weibo.com/2771958513/MduZ58bhC?refer_flag=1001030103_

https://weibo.com/2771958513/MdXwn1fY1?refer_flag=1001030103_

https://weibo.com/2771958513/MeSCu50Yo?refer_flag=1001030103_

https://weibo.com/2771958513/Mf9NTxikG?refer_flag=1001030103_

https://weibo.com/2773213611/LFucRtyLD?refer_flag=1001030103_

https://weibo.com/2792675770/LDr5Hnzhk?refer_flag=1001030103_

https://weibo.com/2793092803/LDsbs4oFW?refer_flag=1001030103_

https://weibo.com/2816866443/Mdd5q2esJ?refer_flag=1001030103_

https://weibo.com/2833758941/MlYVWoU94?refer_flag=1001030103_

https://weibo.com/2836105680/LDCE3A4o8?refer_flag=1001030103_

https://weibo.com/2844119394/LDiYn381d?refer_flag=1001030103_

https://weibo.com/2853016445/LDtksy7jb?refer_flag=1001030103_

https://weibo.com/3023300704/LDqBevXr8?refer_flag=1001030103_

https://weibo.com/3167150345/Ml2zNzumj?refer_flag=1001030103_

https://weibo.com/3237639015/M2fCq3o45?refer_flag=1001030103_

https://weibo.com/3502957945/LDm5f2zXH?refer_flag=1001030103_

https://weibo.com/3612743004/MfWamag5s?refer_flag=1001030103_

https://weibo.com/3655327240/LBWi9ARlH?refer_flag=1001030103_

https://weibo.com/3657809233/M0hxADdHR?refer_flag=1001030103_

https://weibo.com/3736073954/M0BBCAZM7?refer_flag=1001030103_

https://weibo.com/3823453652/LDpTm20dQ?refer_flag=1001030103_

https://weibo.com/3849473546/MmKlBltWv?refer_flag=1001030103_

https://weibo.com/3883086756/MgN3U7N2K?refer_flag=1001030103_

https://weibo.com/3930009466/MmgD7A69W?refer_flag=1001030103_

https://weibo.com/3939212872/Me3OZgdEe?refer_flag=1001030103_

https://weibo.com/3955261359/LDqFnk7xI?refer_flag=1001030103_

https://weibo.com/3960037780/MjSW6cutj?refer_flag=1001030103_

https://weibo.com/3961262748/M1bLBgvGG?refer_flag=1001030103_

https://weibo.com/3962732707/M4LGEyuYP?refer_flag=1001030103_

https://weibo.com/5073176190/LDhzKqFj6?refer_flag=1001030103_

https://weibo.com/5077548082/MjQZ0FASc?refer_flag=1001030103_

https://weibo.com/5081544849/Mic5M7YXj?refer_flag=1001030103_

https://weibo.com/5094103156/LDrkFfqTm?refer_flag=1001030103_

Fuller 发表于 2024-1-23 22:44
我测试了你的第一个网址，采集成功。你把所有网址发出来我试试。不要发截图，发文本网址
...

https://weibo.com/5110439722/LDqIY9myu?refer_flag=1001030103_

https://weibo.com/5186710837/MhV4bDP4E?refer_flag=1001030103_

https://weibo.com/5217890053/MgN3U7MtX?refer_flag=1001030103_

https://weibo.com/5256824744/LDrKu8wcA?refer_flag=1001030103_

https://weibo.com/5286879323/LDvukmbH3?refer_flag=1001030103_

https://weibo.com/5312228022/MmRZraM67?refer_flag=1001030103_

https://weibo.com/5316199743/MbvShqipP?refer_flag=1001030103_

https://weibo.com/5318056985/LDrSdagrh?refer_flag=1001030103_

https://weibo.com/5356028147/MgN3Ua0j1?refer_flag=1001030103_

https://weibo.com/5364329434/Mjz6Bhw3v?refer_flag=1001030103_

https://weibo.com/5509810414/LDsc8Ciy1?refer_flag=1001030103_

https://weibo.com/5532473321/MgkI76avk?refer_flag=1001030103_

https://weibo.com/5651448613/M0Ypvffww?refer_flag=1001030103_

https://weibo.com/5652088597/MmLlzBg86?refer_flag=1001030103_

https://weibo.com/5655468638/M3zB8lSnn?refer_flag=1001030103_

https://weibo.com/5656145123/MmL5e33Kz?refer_flag=1001030103_

https://weibo.com/5684729210/MidlWqrr9?refer_flag=1001030103_

https://weibo.com/5722827778/MhpG8zoun?refer_flag=1001030103_

https://weibo.com/5726836624/MjPBJqfFX?refer_flag=1001030103_

https://weibo.com/5737990122/LCU4KqfzO?refer_flag=1001030103_

https://weibo.com/5780728064/LDr42xCxv?refer_flag=1001030103_

https://weibo.com/5794709754/MgN3U8SQ2?refer_flag=1001030103_

https://weibo.com/5815778859/MgN3Ub4ML?refer_flag=1001030103_

https://weibo.com/5845965470/LDqLS9X9G?refer_flag=1001030103_

https://weibo.com/5881975508/M6TZC4Rbo?refer_flag=1001030103_

https://weibo.com/5881975508/MdlnpqSQD?refer_flag=1001030103_

https://weibo.com/5881975508/MmgnQfpkZ?refer_flag=1001030103_

https://weibo.com/5886211231/LDqYkh93A?refer_flag=1001030103_

https://weibo.com/5886225740/MgN3ThRP8?refer_flag=1001030103_

https://weibo.com/5886285543/MgN3Ua0dI?refer_flag=1001030103_

https://weibo.com/5886288469/MgN3U5zHj?refer_flag=1001030103_

https://weibo.com/5886337122/MgN3TcloD?refer_flag=1001030103_

https://weibo.com/5886588857/MgN3TfFa5?refer_flag=1001030103_

https://weibo.com/5906107624/MlomvrHw9?refer_flag=1001030103_

https://weibo.com/5922754405/MgN3Ub52T?refer_flag=1001030103_

https://weibo.com/5922755296/MgN3U6G1x?refer_flag=1001030103_

https://weibo.com/5943595658/LDqG2pAWy?refer_flag=1001030103_

https://weibo.com/5976905839/LDsnglluh?refer_flag=1001030103_

https://weibo.com/5977326258/M2ghnvOc4?refer_flag=1001030103_

https://weibo.com/5983389644/MkBgF3WVp?refer_flag=1001030103_

https://weibo.com/5985604592/MgN3U7Mb7?refer_flag=1001030103_

https://weibo.com/5993531560/LDqFvzkZw?refer_flag=1001030103_

https://weibo.com/6010633265/MgN3TgLD4?refer_flag=1001030103_

https://weibo.com/6014513352/LDqJ89VHc?refer_flag=1001030103_

https://weibo.com/6034924146/LDqLegqP5?refer_flag=1001030103_

https://weibo.com/6079850543/LDmfzAC6w?refer_flag=1001030103_

https://weibo.com/6087911937/MmREg0Ow8?refer_flag=1001030103_

https://weibo.com/6128768296/MiB3Jz260?refer_flag=1001030103_

https://weibo.com/6133939607/MgN3TtWKB?refer_flag=1001030103_

https://weibo.com/6137757065/MdG5X0ga6?refer_flag=1001030103_

https://weibo.com/6139564618/LDtooERzq?refer_flag=1001030103_

https://weibo.com/6186668529/M3bzx0APj?refer_flag=1001030103_

https://weibo.com/6225934920/M3ZKur33i?refer_flag=1001030103_

https://weibo.com/6228270569/M0QtP6NHu?refer_flag=1001030103_

https://weibo.com/6231345267/LDsPOBHQS?refer_flag=1001030103_

https://weibo.com/6276411735/M6BJW7g9U?refer_flag=1001030103_

https://weibo.com/6283168072/LDBwW66Lc?refer_flag=1001030103_

https://weibo.com/6297585535/MgaOes4DO?refer_flag=1001030103_

https://weibo.com/6331980345/LDmKewSMK?refer_flag=1001030103_

https://weibo.com/6336020792/LDNBM6vaK?refer_flag=1001030103_

https://weibo.com/6336384871/MajUpuxF5?refer_flag=1001030103_

https://weibo.com/6338156111/M4sjgsloq?refer_flag=1001030103_

https://weibo.com/6349337215/LDsvTts1K?refer_flag=1001030103_

https://weibo.com/6396317880/M0dI2pAL3?refer_flag=1001030103_

https://weibo.com/6399625453/MgeqwmMU1?refer_flag=1001030103_

https://weibo.com/6421111471/LDrWlnSSe?refer_flag=1001030103_

https://weibo.com/6439151235/M1cM11kVN?refer_flag=1001030103_

https://weibo.com/6506873936/LDtmuta7E?refer_flag=1001030103_

https://weibo.com/6508016609/LDsbsn5qa?refer_flag=1001030103_

https://weibo.com/6525597692/LDtkBbLW9?refer_flag=1001030103_

https://weibo.com/6525597692/M7d2KFmta?refer_flag=1001030103_

https://weibo.com/6558667180/MmSjj2Y0X?refer_flag=1001030103_

https://weibo.com/6570571335/MnbMrgtR9?refer_flag=1001030103_

https://weibo.com/6572403506/MenAsd6K5?refer_flag=1001030103_

https://weibo.com/6574414250/MgN3Tzsw4?refer_flag=1001030103_

https://weibo.com/6587760082/M5neREHxx?refer_flag=1001030103_

https://weibo.com/6588473744/MgN3Upo6q?refer_flag=1001030103_

https://weibo.com/6589800607/MmKy13IlO?refer_flag=1001030103_

https://weibo.com/6715252094/LDmlkA71R?refer_flag=1001030103_

https://weibo.com/6725153071/M0AgLFpdB?refer_flag=1001030103_

https://weibo.com/6746738378/MaDRKtq4M?refer_flag=1001030103_

https://weibo.com/6748664619/M83dCBVov?refer_flag=1001030103_

https://weibo.com/6788499283/LDqGucgaC?refer_flag=1001030103_

https://weibo.com/6822335746/MgN3UrA74?refer_flag=1001030103_

https://weibo.com/6854073802/M6TCfAIrB?refer_flag=1001030103_

https://weibo.com/6890756658/MmKAXmHC2?refer_flag=1001030103_

https://weibo.com/6894787684/MgN3Ub4xF?refer_flag=1001030103_

https://weibo.com/7024095958/M2yE49F0y?refer_flag=1001030103_

https://weibo.com/7055239957/LDazTdVKq?refer_flag=1001030103_

https://weibo.com/7093268990/LDrLDowyR?refer_flag=1001030103_

https://weibo.com/7195578310/M2XVIjJuB?refer_flag=1001030103_

https://weibo.com/7217363864/LDmljEExU?refer_flag=1001030103_

https://weibo.com/7299085607/MnwYg5xug?refer_flag=1001030103_

https://weibo.com/7303731156/LDlDEnZJQ?refer_flag=1001030103_

https://weibo.com/7319018638/MfW7w7VFD?refer_flag=1001030103_

https://weibo.com/7330849100/LDrN64jJy?refer_flag=1001030103_

https://weibo.com/7331181368/M14Jad7r3?refer_flag=1001030103_

https://weibo.com/7340535338/LDrdth8OG?refer_flag=1001030103_

https://weibo.com/7341462570/MnwtObynk?refer_flag=1001030103_

https://weibo.com/7343316773/LDme0mByc?refer_flag=1001030103_

https://weibo.com/7357411981/LDmdjffFZ?refer_flag=1001030103_

https://weibo.com/7390141101/M13Jbjw7F?refer_flag=1001030103_

https://weibo.com/7399555658/LDr8uvTHC?refer_flag=1001030103_

https://weibo.com/7415939347/MjzUpuReL?refer_flag=1001030103_

https://weibo.com/7434854875/LDr8AojKV?refer_flag=1001030103_

https://weibo.com/7435221765/LDqD1lISu?refer_flag=1001030103_

https://weibo.com/7442413095/MmUgbj1FL?refer_flag=1001030103_

https://weibo.com/7456271296/M2tYxl0n9?refer_flag=1001030103_

https://weibo.com/7488141987/MfVEdrL3o?refer_flag=1001030103_

https://weibo.com/7488557200/MfVGvyw7D?refer_flag=1001030103_

Fuller 发表于 2024-1-23 22:44
我测试了你的第一个网址，采集成功。你把所有网址发出来我试试。不要发截图，发文本网址
...

https://weibo.com/7491094789/LFIwVpVwJ?refer_flag=1001030103_

https://weibo.com/7496361367/LDrPf70O9?refer_flag=1001030103_

https://weibo.com/7520789718/LDmsGbTm4?refer_flag=1001030103_

https://weibo.com/7523386243/LDr9UiMcy?refer_flag=1001030103_

https://weibo.com/7549907640/MbkUWgM2J?refer_flag=1001030103_

https://weibo.com/7556670743/M0gUF3DhP?refer_flag=1001030103_

https://weibo.com/7682926193/M2u3J8yB4?refer_flag=1001030103_

https://weibo.com/7690219928/LDsgMFfCE?refer_flag=1001030103_

https://weibo.com/7705451723/MfCz51oKA?refer_flag=1001030103_

https://weibo.com/7708039348/LDsot5Vsn?refer_flag=1001030103_

https://weibo.com/7719155758/M1BIVaiIq?refer_flag=1001030103_

https://weibo.com/7736581230/MfW9hbaxk?refer_flag=1001030103_

https://weibo.com/7737199904/MfVOnpZIe?refer_flag=1001030103_

https://weibo.com/7737384180/MfVR7jppV?refer_flag=1001030103_

https://weibo.com/7767796507/MfWeN25x7?refer_flag=1001030103_

https://weibo.com/7768031018/M2u3xdMya?refer_flag=1001030103_

https://weibo.com/7769662690/MfWc35onk?refer_flag=1001030103_

https://weibo.com/7769867879/MfVKE1LsH?refer_flag=1001030103_

https://weibo.com/7769894734/MfWiQuNzM?refer_flag=1001030103_

https://weibo.com/7769985914/MfVJ6B4pB?refer_flag=1001030103_

https://weibo.com/7770012240/MfWkajKKy?refer_flag=1001030103_

https://weibo.com/7781094904/MlPLHaB9b?refer_flag=1001030103_

https://weibo.com/7785083741/Mm9VCDyJz?refer_flag=1001030103_

https://weibo.com/7795764044/MdvpcdLCE?refer_flag=1001030103_

https://weibo.com/972897/LDlqE1pyJ?refer_flag=1001030103_

https://weibo.com/972897/MmKEQa7M1?refer_flag=1001030103_

我们测试了第一部分的116条链接，没有问题。如果是国外的话，有可能是网络问题。

Fuller 发表于 2024-1-25 00:13
我们测试了第一部分的116条链接，没有问题。如果是国外的话，有可能是网络问题。 ...

啊，那要怎么办呢，贵站可以帮我从国内的网络收一下吗？

lzl0927 发表于 2024-1-26 02:27
啊，那要怎么办呢，贵站可以帮我从国内的网络收一下吗？

加用户QQ群337462280，联系群里的管理员。代采集要收取费用。

喜马拉雅声音评论采集抓取失败，选的类别-网站-页面分别是热门网站-喜马拉雅-喜马拉雅声音评论采集，链接是：https://www.ximalaya.com/album/6253954，已登入个人账号，试了三次都失败，采集状态是【已停止？】，点进去看状态是【抓取出错】。不知道哪里出现了问题，求解sos。

绵冰 发表于 2024-2-11 20:11
喜马拉雅声音评论采集抓取失败，选的类别-网站-页面分别是热门网站-喜马拉雅-喜马拉雅声音评论采集，链接是 ...

见这个帖子的回复：喜马拉雅声音评论采集抓取失败

微博签到采集-此地热议为什么不能翻页啊？手工翻页后为什么只采集了两页就结束了呢？