⊟
184 KB
/srv/reproducible-results/rbuild-debian/r-b-build.lVXKZYeQ/b1/python-scrapy_2.11.1-2_arm64.changes vs.
/srv/reproducible-results/rbuild-debian/r-b-build.lVXKZYeQ/b2/python-scrapy_2.11.1-2_arm64.changes
⊟
298 B
Files
    
Offset 1, 3 lines modifiedOffset 1, 3 lines modified
  
1 ·c178dcfb236113ddda4c3e6851d887f2·850160·doc·optional·python-scrapy-doc_2.11.1-2_all.deb1 ·88a861cd04310c391f00a57d452b646a·850192·doc·optional·python-scrapy-doc_2.11.1-2_all.deb
2 ·de3821ca1f26c290f5dd9a6839cf9f10·259292·python·optional·python3-scrapy_2.11.1-2_all.deb2 ·de3821ca1f26c290f5dd9a6839cf9f10·259292·python·optional·python3-scrapy_2.11.1-2_all.deb
⊟
184 KB
python-scrapy-doc_2.11.1-2_all.deb
⊟
452 B
file list
    
Offset 1, 3 lines modifiedOffset 1, 3 lines modified
1 -rw-r--r--···0········0········0········4·2024-04-24·06:31:47.000000·debian-binary1 -rw-r--r--···0········0········0········4·2024-04-24·06:31:47.000000·debian-binary
2 -rw-r--r--···0········0········0·····5068·2024-04-24·06:31:47.000000·control.tar.xz2 -rw-r--r--···0········0········0·····5052·2024-04-24·06:31:47.000000·control.tar.xz
3 -rw-r--r--···0········0········0···844900·2024-04-24·06:31:47.000000·data.tar.xz3 -rw-r--r--···0········0········0···844948·2024-04-24·06:31:47.000000·data.tar.xz
⊟
98.0 B
control.tar.xz
⊟
70.0 B
control.tar
⊟
48.0 B
./md5sums
⊟
30.0 B
./md5sums
Files differ
⊟
183 KB
data.tar.xz
⊟
183 KB
data.tar
⊟
1.34 KB
./usr/share/doc/python-scrapy-doc/html/404.html
    
Offset 152, 15 lines modifiedOffset 152, 15 lines modified
152 ···········</div>152 ···········</div>
153 ··········</div>153 ··········</div>
154 ··········<footer>154 ··········<footer>
  
155 ··<hr/>155 ··<hr/>
  
156 ··<div·role="contentinfo">156 ··<div·role="contentinfo">
157 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.157 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
158 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.158 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
159 ······</span></p>159 ······</span></p>
160 ··</div>160 ··</div>
  
161 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a161 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
162 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>162 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
163 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.163 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
736 B
html2text {}
    
Offset 57, 9 lines modifiedOffset 57, 9 lines modified
57 ····*·_\x8V_\x8e_\x8r_\x8s_\x8i_\x8o_\x8n_\x8i_\x8n_\x8g_\x8·_\x8a_\x8n_\x8d_\x8·_\x8A_\x8P_\x8I_\x8·_\x8s_\x8t_\x8a_\x8b_\x8i_\x8l_\x8i_\x8t_\x8y57 ····*·_\x8V_\x8e_\x8r_\x8s_\x8i_\x8o_\x8n_\x8i_\x8n_\x8g_\x8·_\x8a_\x8n_\x8d_\x8·_\x8A_\x8P_\x8I_\x8·_\x8s_\x8t_\x8a_\x8b_\x8i_\x8l_\x8i_\x8t_\x8y
58 _\x8S_\x8c_\x8r_\x8a_\x8p_\x8y58 _\x8S_\x8c_\x8r_\x8a_\x8p_\x8y
59 ····*·Page·not·found59 ····*·Page·not·found
60 ===============================================================================60 ===============================================================================
61 *\x8**\x8**\x8**\x8**\x8**\x8*·P\x8Pa\x8ag\x8ge\x8e·n\x8no\x8ot\x8t·f\x8fo\x8ou\x8un\x8nd\x8d·*\x8**\x8**\x8**\x8**\x8**\x8*61 *\x8**\x8**\x8**\x8**\x8**\x8*·P\x8Pa\x8ag\x8ge\x8e·n\x8no\x8ot\x8t·f\x8fo\x8ou\x8un\x8nd\x8d·*\x8**\x8**\x8**\x8**\x8**\x8*
62 Unfortunately·we·couldn't·find·the·content·you·were·looking·for.62 Unfortunately·we·couldn't·find·the·content·you·were·looking·for.
63 ===============================================================================63 ===============================================================================
64 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.64 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
65 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.65 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.28 KB
./usr/share/doc/python-scrapy-doc/html/README.html
    
Offset 206, 15 lines modifiedOffset 206, 15 lines modified
206 ···········</div>206 ···········</div>
207 ··········</div>207 ··········</div>
208 ··········<footer>208 ··········<footer>
  
209 ··<hr/>209 ··<hr/>
  
210 ··<div·role="contentinfo">210 ··<div·role="contentinfo">
211 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.211 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
212 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.212 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
213 ······</span></p>213 ······</span></p>
214 ··</div>214 ··</div>
  
215 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a215 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
216 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>216 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
217 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.217 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
670 B
html2text {}
    
Offset 85, 9 lines modifiedOffset 85, 9 lines modified
85 make·watch85 make·watch
86 *\x8**\x8**\x8**\x8**\x8*·A\x8Al\x8lt\x8te\x8er\x8rn\x8na\x8at\x8ti\x8iv\x8ve\x8e·m\x8me\x8et\x8th\x8ho\x8od\x8d·u\x8us\x8si\x8in\x8ng\x8g·t\x8to\x8ox\x8x_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*86 *\x8**\x8**\x8**\x8**\x8*·A\x8Al\x8lt\x8te\x8er\x8rn\x8na\x8at\x8ti\x8iv\x8ve\x8e·m\x8me\x8et\x8th\x8ho\x8od\x8d·u\x8us\x8si\x8in\x8ng\x8g·t\x8to\x8ox\x8x_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*
87 To·compile·the·documentation·to·HTML·run·the·following·command:87 To·compile·the·documentation·to·HTML·run·the·following·command:
88 tox·-e·docs88 tox·-e·docs
89 Documentation·will·be·generated·(in·HTML·format)·inside·the·.tox/docs/tmp/html89 Documentation·will·be·generated·(in·HTML·format)·inside·the·.tox/docs/tmp/html
90 dir.90 dir.
91 ===============================================================================91 ===============================================================================
92 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.92 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
93 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.93 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.41 KB
./usr/share/doc/python-scrapy-doc/html/_modules/index.html
    
Offset 222, 15 lines modifiedOffset 222, 15 lines modified
222 ···········</div>222 ···········</div>
223 ··········</div>223 ··········</div>
224 ··········<footer>224 ··········<footer>
  
225 ··<hr/>225 ··<hr/>
  
226 ··<div·role="contentinfo">226 ··<div·role="contentinfo">
227 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.227 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
228 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.228 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
229 ······</span></p>229 ······</span></p>
230 ··</div>230 ··</div>
  
231 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a231 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
232 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>232 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
233 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.233 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
787 B
html2text {}
    
Offset 127, 9 lines modifiedOffset 127, 9 lines modified
127 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8i_\x8t_\x8e_\x8r_\x8a_\x8t_\x8o_\x8r_\x8s127 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8i_\x8t_\x8e_\x8r_\x8a_\x8t_\x8o_\x8r_\x8s
128 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8l_\x8o_\x8g128 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8l_\x8o_\x8g
129 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8r_\x8e_\x8a_\x8c_\x8t_\x8o_\x8r129 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8r_\x8e_\x8a_\x8c_\x8t_\x8o_\x8r
130 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8r_\x8e_\x8q_\x8u_\x8e_\x8s_\x8t130 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8r_\x8e_\x8q_\x8u_\x8e_\x8s_\x8t
131 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8r_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e131 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8r_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e
132 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8t_\x8r_\x8a_\x8c_\x8k_\x8r_\x8e_\x8f132 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8t_\x8r_\x8a_\x8c_\x8k_\x8r_\x8e_\x8f
133 ===============================================================================133 ===============================================================================
134 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.134 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
135 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.135 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.19 KB
./usr/share/doc/python-scrapy-doc/html/_modules/itemadapter/adapter.html
    
Offset 525, 15 lines modifiedOffset 525, 15 lines modified
525 ···········</div>525 ···········</div>
526 ··········</div>526 ··········</div>
527 ··········<footer>527 ··········<footer>
  
528 ··<hr/>528 ··<hr/>
  
529 ··<div·role="contentinfo">529 ··<div·role="contentinfo">
530 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.530 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
531 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.531 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
532 ······</span></p>532 ······</span></p>
533 ··</div>533 ··</div>
  
534 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a534 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
535 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>535 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
536 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.536 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
536 B
html2text {}
    
Offset 465, 9 lines modifiedOffset 465, 9 lines modified
465 ········if·isinstance(obj,·cls):465 ········if·isinstance(obj,·cls):
466 ············return·obj.asdict()466 ············return·obj.asdict()
467 ········if·cls.is_item(obj):467 ········if·cls.is_item(obj):
468 ············return·cls(obj).asdict()468 ············return·cls(obj).asdict()
469 ········return·obj469 ········return·obj
  
470 ===============================================================================470 ===============================================================================
471 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.471 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
472 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.472 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.2 KB
./usr/share/doc/python-scrapy-doc/html/_modules/itemadapter/utils.html
    
Offset 287, 15 lines modifiedOffset 287, 15 lines modified
287 ···········</div>287 ···········</div>
288 ··········</div>288 ··········</div>
289 ··········<footer>289 ··········<footer>
  
290 ··<hr/>290 ··<hr/>
  
291 ··<div·role="contentinfo">291 ··<div·role="contentinfo">
292 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.292 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
293 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.293 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
294 ······</span></p>294 ······</span></p>
295 ··</div>295 ··</div>
  
296 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a296 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
297 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>297 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
298 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.298 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
547 B
html2text {}
    
Offset 200, 9 lines modifiedOffset 200, 9 lines modified
200 ········category=DeprecationWarning,200 ········category=DeprecationWarning,
201 ········stacklevel=2,201 ········stacklevel=2,
202 ····)202 ····)
203 ····from·itemadapter.adapter·import·ScrapyItemAdapter203 ····from·itemadapter.adapter·import·ScrapyItemAdapter
  
204 ····return·ScrapyItemAdapter.is_item(obj)204 ····return·ScrapyItemAdapter.is_item(obj)
205 ===============================================================================205 ===============================================================================
206 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.206 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
207 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.207 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.31 KB
./usr/share/doc/python-scrapy-doc/html/_modules/itemloaders.html
    
Offset 707, 15 lines modifiedOffset 707, 15 lines modified
707 ···········</div>707 ···········</div>
708 ··········</div>708 ··········</div>
709 ··········<footer>709 ··········<footer>
  
710 ··<hr/>710 ··<hr/>
  
711 ··<div·role="contentinfo">711 ··<div·role="contentinfo">
712 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.712 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
713 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.713 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
714 ······</span></p>714 ······</span></p>
715 ··</div>715 ··</div>
  
716 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a716 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
717 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>717 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
718 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.718 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
672 B
html2text {}
    
Offset 648, 9 lines modifiedOffset 648, 9 lines modified
648 ········jmess·=·arg_to_iter(jmess)648 ········jmess·=·arg_to_iter(jmess)
649 ········if·not·hasattr(self.selector,·"jmespath"):649 ········if·not·hasattr(self.selector,·"jmespath"):
650 ············raise·AttributeError(650 ············raise·AttributeError(
651 ················"Please·install·parsel·>=·1.8.1·to·get·jmespath·support"651 ················"Please·install·parsel·>=·1.8.1·to·get·jmespath·support"
652 ············)652 ············)
653 ········return·flatten(self.selector.jmespath(jmes).getall()·for·jmes·in·jmess)653 ········return·flatten(self.selector.jmespath(jmes).getall()·for·jmes·in·jmess)
654 ===============================================================================654 ===============================================================================
655 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.655 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
656 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.656 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.25 KB
./usr/share/doc/python-scrapy-doc/html/_modules/parsel/selector.html
    
Offset 1051, 15 lines modifiedOffset 1051, 15 lines modified
1051 ···········</div>1051 ···········</div>
1052 ··········</div>1052 ··········</div>
1053 ··········<footer>1053 ··········<footer>
  
1054 ··<hr/>1054 ··<hr/>
  
1055 ··<div·role="contentinfo">1055 ··<div·role="contentinfo">
1056 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.1056 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
1057 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.1057 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
1058 ······</span></p>1058 ······</span></p>
1059 ··</div>1059 ··</div>
  
1060 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a1060 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
1061 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>1061 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
1062 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.1062 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
609 B
html2text {}
    
Offset 996, 9 lines modifiedOffset 996, 9 lines modified
996 ····def·__str__(self)·->·str:996 ····def·__str__(self)·->·str:
997 ········return·str(self.get())997 ········return·str(self.get())
  
998 ····def·__repr__(self)·->·str:998 ····def·__repr__(self)·->·str:
999 ········data·=·repr(shorten(str(self.get()),·width=40))999 ········data·=·repr(shorten(str(self.get()),·width=40))
1000 ········return·f"<{type(self).__name__}·query={self._expr!r}·data={data}>"1000 ········return·f"<{type(self).__name__}·query={self._expr!r}·data={data}>"
1001 ===============================================================================1001 ===============================================================================
1002 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.1002 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
1003 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.1003 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.23 KB
./usr/share/doc/python-scrapy-doc/html/_modules/parsel/xpathfuncs.html
    
Offset 213, 15 lines modifiedOffset 213, 15 lines modified
213 ···········</div>213 ···········</div>
214 ··········</div>214 ··········</div>
215 ··········<footer>215 ··········<footer>
  
216 ··<hr/>216 ··<hr/>
  
217 ··<div·role="contentinfo">217 ··<div·role="contentinfo">
218 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.218 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
219 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.219 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
220 ······</span></p>220 ······</span></p>
221 ··</div>221 ··</div>
  
222 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a222 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
223 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>223 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
224 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.224 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
586 B
html2text {}
    
Offset 123, 9 lines modifiedOffset 123, 9 lines modified
123 ····node_cls·=·"·"·+·node_cls·+·"·"123 ····node_cls·=·"·"·+·node_cls·+·"·"
124 ····node_cls·=·replace_html5_whitespaces("·",·node_cls)124 ····node_cls·=·replace_html5_whitespaces("·",·node_cls)
125 ····for·cls·in·classes:125 ····for·cls·in·classes:
126 ········if·"·"·+·cls·+·"·"·not·in·node_cls:126 ········if·"·"·+·cls·+·"·"·not·in·node_cls:
127 ············return·False127 ············return·False
128 ····return·True128 ····return·True
129 ===============================================================================129 ===============================================================================
130 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.130 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
131 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.131 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.29 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/contracts/default.html
    
Offset 275, 15 lines modifiedOffset 275, 15 lines modified
275 ···········</div>275 ···········</div>
276 ··········</div>276 ··········</div>
277 ··········<footer>277 ··········<footer>
  
278 ··<hr/>278 ··<hr/>
  
279 ··<div·role="contentinfo">279 ··<div·role="contentinfo">
280 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.280 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
281 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.281 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
282 ······</span></p>282 ······</span></p>
283 ··</div>283 ··</div>
  
284 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a284 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
285 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>285 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
286 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.286 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
629 B
html2text {}
    
Offset 185, 9 lines modifiedOffset 185, 9 lines modified
185 ················missing·=·[arg·for·arg·in·self.args·if·arg·not·in·ItemAdapter185 ················missing·=·[arg·for·arg·in·self.args·if·arg·not·in·ItemAdapter
186 (x)]186 (x)]
187 ················if·missing:187 ················if·missing:
188 ····················missing_fields·=·",·".join(missing)188 ····················missing_fields·=·",·".join(missing)
189 ····················raise·ContractFail(f"Missing·fields:·{missing_fields}")189 ····················raise·ContractFail(f"Missing·fields:·{missing_fields}")
  
190 ===============================================================================190 ===============================================================================
191 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.191 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
192 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.192 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.24 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/contracts.html
    
Offset 348, 15 lines modifiedOffset 348, 15 lines modified
348 ···········</div>348 ···········</div>
349 ··········</div>349 ··········</div>
350 ··········<footer>350 ··········<footer>
  
351 ··<hr/>351 ··<hr/>
  
352 ··<div·role="contentinfo">352 ··<div·role="contentinfo">
353 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.353 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
354 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.354 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
355 ······</span></p>355 ······</span></p>
356 ··</div>356 ··</div>
  
357 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a357 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
358 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>358 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
359 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.359 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
598 B
html2text {}
    
Offset 257, 9 lines modifiedOffset 257, 9 lines modified
257 ········def·__str__(_self):257 ········def·__str__(_self):
258 ············return·f"[{spider}]·{method.__name__}·({desc})"258 ············return·f"[{spider}]·{method.__name__}·({desc})"
  
259 ····name·=·f"{spider}_{method.__name__}"259 ····name·=·f"{spider}_{method.__name__}"
260 ····setattr(ContractTestCase,·name,·lambda·x:·x)260 ····setattr(ContractTestCase,·name,·lambda·x:·x)
261 ····return·ContractTestCase(name)261 ····return·ContractTestCase(name)
262 ===============================================================================262 ===============================================================================
263 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.263 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
264 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.264 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.26 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/core/scheduler.html
    
Offset 568, 15 lines modifiedOffset 568, 15 lines modified
568 ···········</div>568 ···········</div>
569 ··········</div>569 ··········</div>
570 ··········<footer>570 ··········<footer>
  
571 ··<hr/>571 ··<hr/>
  
572 ··<div·role="contentinfo">572 ··<div·role="contentinfo">
573 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.573 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
574 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.574 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
575 ······</span></p>575 ······</span></p>
576 ··</div>576 ··</div>
  
577 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a577 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
578 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>578 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
579 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.579 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
602 B
html2text {}
    
Offset 530, 9 lines modifiedOffset 530, 9 lines modified
530 ············return·cast(list,·json.load(f))530 ············return·cast(list,·json.load(f))
  
531 ····def·_write_dqs_state(self,·dqdir:·str,·state:·list)·->·None:531 ····def·_write_dqs_state(self,·dqdir:·str,·state:·list)·->·None:
532 ········with·Path(dqdir,·"active.json").open("w",·encoding="utf-8")·as·f:532 ········with·Path(dqdir,·"active.json").open("w",·encoding="utf-8")·as·f:
533 ············json.dump(state,·f)533 ············json.dump(state,·f)
  
534 ===============================================================================534 ===============================================================================
535 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.535 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
536 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.536 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.17 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/crawler.html
    
Offset 624, 15 lines modifiedOffset 624, 15 lines modified
624 ···········</div>624 ···········</div>
625 ··········</div>625 ··········</div>
626 ··········<footer>626 ··········<footer>
  
627 ··<hr/>627 ··<hr/>
  
628 ··<div·role="contentinfo">628 ··<div·role="contentinfo">
629 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.629 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
630 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.630 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
631 ······</span></p>631 ······</span></p>
632 ··</div>632 ··</div>
  
633 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a633 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
634 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>634 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
635 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.635 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
523 B
html2text {}
    
Offset 554, 9 lines modifiedOffset 554, 9 lines modified
  
554 ········try:554 ········try:
555 ············reactor.stop()555 ············reactor.stop()
556 ········except·RuntimeError:··#·raised·if·already·stopped·or·in·shutdown·stage556 ········except·RuntimeError:··#·raised·if·already·stopped·or·in·shutdown·stage
557 ············pass557 ············pass
  
558 ===============================================================================558 ===============================================================================
559 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.559 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
560 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.560 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.3 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/ajaxcrawl.html
    
Offset 250, 15 lines modifiedOffset 250, 15 lines modified
250 ···········</div>250 ···········</div>
251 ··········</div>251 ··········</div>
252 ··········<footer>252 ··········<footer>
  
253 ··<hr/>253 ··<hr/>
  
254 ··<div·role="contentinfo">254 ··<div·role="contentinfo">
255 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.255 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
256 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.256 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
257 ······</span></p>257 ······</span></p>
258 ··</div>258 ··</div>
  
259 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a259 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
260 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>260 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
261 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.261 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
610 B
html2text {}
    
Offset 162, 9 lines modifiedOffset 162, 9 lines modified
162 ········return·False162 ········return·False
  
163 ····text·=·html.remove_tags_with_content(text,·("script",·"noscript"))163 ····text·=·html.remove_tags_with_content(text,·("script",·"noscript"))
164 ····text·=·html.replace_entities(text)164 ····text·=·html.replace_entities(text)
165 ····text·=·html.remove_comments(text)165 ····text·=·html.remove_comments(text)
166 ····return·_ajax_crawlable_re.search(text)·is·not·None166 ····return·_ajax_crawlable_re.search(text)·is·not·None
167 ===============================================================================167 ===============================================================================
168 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.168 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
169 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.169 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.32 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/cookies.html
    
Offset 299, 15 lines modifiedOffset 299, 15 lines modified
299 ···········</div>299 ···········</div>
300 ··········</div>300 ··········</div>
301 ··········<footer>301 ··········<footer>
  
302 ··<hr/>302 ··<hr/>
  
303 ··<div·role="contentinfo">303 ··<div·role="contentinfo">
304 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.304 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
305 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.305 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
306 ······</span></p>306 ······</span></p>
307 ··</div>307 ··</div>
  
308 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a308 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
309 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>309 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
310 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.310 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
636 B
html2text {}
    
Offset 209, 9 lines modifiedOffset 209, 9 lines modified
209 ············cookies·=·request.cookies209 ············cookies·=·request.cookies
210 ········formatted·=·filter(None,·(self._format_cookie(c,·request)·for·c·in210 ········formatted·=·filter(None,·(self._format_cookie(c,·request)·for·c·in
211 cookies))211 cookies))
212 ········response·=·Response(request.url,·headers={"Set-Cookie":·formatted})212 ········response·=·Response(request.url,·headers={"Set-Cookie":·formatted})
213 ········return·jar.make_cookies(response,·request)213 ········return·jar.make_cookies(response,·request)
  
214 ===============================================================================214 ===============================================================================
215 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.215 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
216 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.216 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.25 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/defaultheaders.html
    
Offset 176, 15 lines modifiedOffset 176, 15 lines modified
176 ···········</div>176 ···········</div>
177 ··········</div>177 ··········</div>
178 ··········<footer>178 ··········<footer>
  
179 ··<hr/>179 ··<hr/>
  
180 ··<div·role="contentinfo">180 ··<div·role="contentinfo">
181 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.181 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
182 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.182 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
183 ······</span></p>183 ······</span></p>
184 ··</div>184 ··</div>
  
185 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a185 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
186 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>186 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
187 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.187 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
549 B
html2text {}
    
Offset 82, 9 lines modifiedOffset 82, 9 lines modified
82 ········return·cls(headers.items())82 ········return·cls(headers.items())
  
83 ····def·process_request(self,·request,·spider):83 ····def·process_request(self,·request,·spider):
84 ········for·k,·v·in·self._headers:84 ········for·k,·v·in·self._headers:
85 ············request.headers.setdefault(k,·v)85 ············request.headers.setdefault(k,·v)
  
86 ===============================================================================86 ===============================================================================
87 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.87 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
88 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.88 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.31 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/downloadtimeout.html
    
Offset 180, 15 lines modifiedOffset 180, 15 lines modified
180 ···········</div>180 ···········</div>
181 ··········</div>181 ··········</div>
182 ··········<footer>182 ··········<footer>
  
183 ··<hr/>183 ··<hr/>
  
184 ··<div·role="contentinfo">184 ··<div·role="contentinfo">
185 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.185 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
186 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.186 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
187 ······</span></p>187 ······</span></p>
188 ··</div>188 ··</div>
  
189 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a189 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
190 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>190 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
191 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.191 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
605 B
html2text {}
    
Offset 85, 9 lines modifiedOffset 85, 9 lines modified
85 ········self._timeout·=·getattr(spider,·"download_timeout",·self._timeout)85 ········self._timeout·=·getattr(spider,·"download_timeout",·self._timeout)
  
86 ····def·process_request(self,·request,·spider):86 ····def·process_request(self,·request,·spider):
87 ········if·self._timeout:87 ········if·self._timeout:
88 ············request.meta.setdefault("download_timeout",·self._timeout)88 ············request.meta.setdefault("download_timeout",·self._timeout)
  
89 ===============================================================================89 ===============================================================================
90 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.90 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
91 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.91 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.29 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/httpauth.html
    
Offset 207, 15 lines modifiedOffset 207, 15 lines modified
207 ···········</div>207 ···········</div>
208 ··········</div>208 ··········</div>
209 ··········<footer>209 ··········<footer>
  
210 ··<hr/>210 ··<hr/>
  
211 ··<div·role="contentinfo">211 ··<div·role="contentinfo">
212 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.212 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
213 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.213 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
214 ······</span></p>214 ······</span></p>
215 ··</div>215 ··</div>
  
216 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a216 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
217 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>217 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
218 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.218 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
608 B
html2text {}
    
Offset 116, 9 lines modifiedOffset 116, 9 lines modified
116 ················self.domain·=·domain116 ················self.domain·=·domain
117 ················self.domain_unset·=·False117 ················self.domain_unset·=·False
118 ············if·not·self.domain·or·url_is_from_any_domain(request.url,118 ············if·not·self.domain·or·url_is_from_any_domain(request.url,
119 [self.domain]):119 [self.domain]):
120 ················request.headers[b"Authorization"]·=·auth120 ················request.headers[b"Authorization"]·=·auth
  
121 ===============================================================================121 ===============================================================================
122 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.122 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
123 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.123 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.36 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/httpcache.html
    
Offset 305, 15 lines modifiedOffset 305, 15 lines modified
305 ···········</div>305 ···········</div>
306 ··········</div>306 ··········</div>
307 ··········<footer>307 ··········<footer>
  
308 ··<hr/>308 ··<hr/>
  
309 ··<div·role="contentinfo">309 ··<div·role="contentinfo">
310 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.310 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
311 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.311 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
312 ······</span></p>312 ······</span></p>
313 ··</div>313 ··</div>
  
314 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a314 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
315 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>315 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
316 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.316 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
672 B
html2text {}
    
Offset 213, 9 lines modifiedOffset 213, 9 lines modified
213 ········if·self.policy.should_cache_response(response,·request):213 ········if·self.policy.should_cache_response(response,·request):
214 ············self.stats.inc_value("httpcache/store",·spider=spider)214 ············self.stats.inc_value("httpcache/store",·spider=spider)
215 ············self.storage.store_response(spider,·request,·response)215 ············self.storage.store_response(spider,·request,·response)
216 ········else:216 ········else:
217 ············self.stats.inc_value("httpcache/uncacheable",·spider=spider)217 ············self.stats.inc_value("httpcache/uncacheable",·spider=spider)
  
218 ===============================================================================218 ===============================================================================
219 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.219 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
220 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.220 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.34 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/httpcompression.html
    
Offset 292, 15 lines modifiedOffset 292, 15 lines modified
292 ···········</div>292 ···········</div>
293 ··········</div>293 ··········</div>
294 ··········<footer>294 ··········<footer>
  
295 ··<hr/>295 ··<hr/>
  
296 ··<div·role="contentinfo">296 ··<div·role="contentinfo">
297 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.297 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
298 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.298 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
299 ······</span></p>299 ······</span></p>
300 ··</div>300 ··</div>
  
301 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a301 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
302 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>302 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
303 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.303 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
640 B
html2text {}
    
Offset 200, 9 lines modifiedOffset 200, 9 lines modified
200 ········if·encoding·==·b"br"·and·b"br"·in·ACCEPTED_ENCODINGS:200 ········if·encoding·==·b"br"·and·b"br"·in·ACCEPTED_ENCODINGS:
201 ············return·_unbrotli(body,·max_size=max_size)201 ············return·_unbrotli(body,·max_size=max_size)
202 ········if·encoding·==·b"zstd"·and·b"zstd"·in·ACCEPTED_ENCODINGS:202 ········if·encoding·==·b"zstd"·and·b"zstd"·in·ACCEPTED_ENCODINGS:
203 ············return·_unzstd(body,·max_size=max_size)203 ············return·_unzstd(body,·max_size=max_size)
204 ········return·body204 ········return·body
  
205 ===============================================================================205 ===============================================================================
206 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.206 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
207 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.207 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.29 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/httpproxy.html
    
Offset 235, 15 lines modifiedOffset 235, 15 lines modified
235 ···········</div>235 ···········</div>
236 ··········</div>236 ··········</div>
237 ··········<footer>237 ··········<footer>
  
238 ··<hr/>238 ··<hr/>
  
239 ··<div·role="contentinfo">239 ··<div·role="contentinfo">
240 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.240 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
241 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.241 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
242 ······</span></p>242 ······</span></p>
243 ··</div>243 ··</div>
  
244 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a244 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
245 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>245 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
246 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.246 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
602 B
html2text {}
    
Offset 142, 9 lines modifiedOffset 142, 9 lines modified
142 ········elif·b"Proxy-Authorization"·in·request.headers:142 ········elif·b"Proxy-Authorization"·in·request.headers:
143 ············if·proxy_url:143 ············if·proxy_url:
144 ················request.meta["_auth_proxy"]·=·proxy_url144 ················request.meta["_auth_proxy"]·=·proxy_url
145 ············else:145 ············else:
146 ················del·request.headers[b"Proxy-Authorization"]146 ················del·request.headers[b"Proxy-Authorization"]
  
147 ===============================================================================147 ===============================================================================
148 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.148 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
149 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.149 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.29 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/redirect.html
    
Offset 301, 15 lines modifiedOffset 301, 15 lines modified
301 ···········</div>301 ···········</div>
302 ··········</div>302 ··········</div>
303 ··········<footer>303 ··········<footer>
  
304 ··<hr/>304 ··<hr/>
  
305 ··<div·role="contentinfo">305 ··<div·role="contentinfo">
306 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.306 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
307 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.307 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
308 ······</span></p>308 ······</span></p>
309 ··</div>309 ··</div>
  
310 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a310 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
311 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>311 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
312 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.312 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
608 B
html2text {}
    
Offset 213, 9 lines modifiedOffset 213, 9 lines modified
213 ········if·url·and·interval·<·self._maxdelay:213 ········if·url·and·interval·<·self._maxdelay:
214 ············redirected·=·self._redirect_request_using_get(request,·url)214 ············redirected·=·self._redirect_request_using_get(request,·url)
215 ············return·self._redirect(redirected,·request,·spider,·"meta·refresh")215 ············return·self._redirect(redirected,·request,·spider,·"meta·refresh")
  
216 ········return·response216 ········return·response
  
217 ===============================================================================217 ===============================================================================
218 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.218 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
219 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.219 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.22 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/retry.html
    
Offset 342, 15 lines modifiedOffset 342, 15 lines modified
342 ···········</div>342 ···········</div>
343 ··········</div>343 ··········</div>
344 ··········<footer>344 ··········<footer>
  
345 ··<hr/>345 ··<hr/>
  
346 ··<div·role="contentinfo">346 ··<div·role="contentinfo">
347 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.347 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
348 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.348 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
349 ······</span></p>349 ······</span></p>
350 ··</div>350 ··</div>
  
351 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a351 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
352 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>352 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
353 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.353 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
537 B
html2text {}
    
Offset 254, 9 lines modifiedOffset 254, 9 lines modified
254 ············max_retry_times=max_retry_times,254 ············max_retry_times=max_retry_times,
255 ············priority_adjust=priority_adjust,255 ············priority_adjust=priority_adjust,
256 ········)256 ········)
  
257 ····__getattr__·=·backwards_compatibility_getattr257 ····__getattr__·=·backwards_compatibility_getattr
  
258 ===============================================================================258 ===============================================================================
259 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.259 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
260 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.260 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.29 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/robotstxt.html
    
Offset 276, 15 lines modifiedOffset 276, 15 lines modified
276 ···········</div>276 ···········</div>
277 ··········</div>277 ··········</div>
278 ··········<footer>278 ··········<footer>
  
279 ··<hr/>279 ··<hr/>
  
280 ··<div·role="contentinfo">280 ··<div·role="contentinfo">
281 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.281 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
282 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.282 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
283 ······</span></p>283 ······</span></p>
284 ··</div>284 ··</div>
  
285 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a285 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
286 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>286 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
287 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.287 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
600 B
html2text {}
    
Offset 185, 9 lines modifiedOffset 185, 9 lines modified
185 ············key·=·f"robotstxt/exception_count/{failure.type}"185 ············key·=·f"robotstxt/exception_count/{failure.type}"
186 ············self.crawler.stats.inc_value(key)186 ············self.crawler.stats.inc_value(key)
187 ········rp_dfd·=·self._parsers[netloc]187 ········rp_dfd·=·self._parsers[netloc]
188 ········self._parsers[netloc]·=·None188 ········self._parsers[netloc]·=·None
189 ········rp_dfd.callback(None)189 ········rp_dfd.callback(None)
  
190 ===============================================================================190 ===============================================================================
191 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.191 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
192 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.192 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.31 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/stats.html
    
Offset 215, 15 lines modifiedOffset 215, 15 lines modified
215 ···········</div>215 ···········</div>
216 ··········</div>216 ··········</div>
217 ··········<footer>217 ··········<footer>
  
218 ··<hr/>218 ··<hr/>
  
219 ··<div·role="contentinfo">219 ··<div·role="contentinfo">
220 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.220 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
221 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.221 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
222 ······</span></p>222 ······</span></p>
223 ··</div>223 ··</div>
  
224 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a224 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
225 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>225 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
226 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.226 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
632 B
html2text {}
    
Offset 122, 9 lines modifiedOffset 122, 9 lines modified
122 ········ex_class·=·global_object_name(exception.__class__)122 ········ex_class·=·global_object_name(exception.__class__)
123 ········self.stats.inc_value("downloader/exception_count",·spider=spider)123 ········self.stats.inc_value("downloader/exception_count",·spider=spider)
124 ········self.stats.inc_value(124 ········self.stats.inc_value(
125 ············f"downloader/exception_type_count/{ex_class}",·spider=spider125 ············f"downloader/exception_type_count/{ex_class}",·spider=spider
126 ········)126 ········)
  
127 ===============================================================================127 ===============================================================================
128 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.128 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
129 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.129 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.29 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/useragent.html
    
Offset 178, 15 lines modifiedOffset 178, 15 lines modified
178 ···········</div>178 ···········</div>
179 ··········</div>179 ··········</div>
180 ··········<footer>180 ··········<footer>
  
181 ··<hr/>181 ··<hr/>
  
182 ··<div·role="contentinfo">182 ··<div·role="contentinfo">
183 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.183 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
184 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.184 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
185 ······</span></p>185 ······</span></p>
186 ··</div>186 ··</div>
  
187 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a187 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
188 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>188 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
189 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.189 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
605 B
html2text {}
    
Offset 83, 9 lines modifiedOffset 83, 9 lines modified
83 ········self.user_agent·=·getattr(spider,·"user_agent",·self.user_agent)83 ········self.user_agent·=·getattr(spider,·"user_agent",·self.user_agent)
  
84 ····def·process_request(self,·request,·spider):84 ····def·process_request(self,·request,·spider):
85 ········if·self.user_agent:85 ········if·self.user_agent:
86 ············request.headers.setdefault(b"User-Agent",·self.user_agent)86 ············request.headers.setdefault(b"User-Agent",·self.user_agent)
  
87 ===============================================================================87 ===============================================================================
88 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.88 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
89 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.89 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.15 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/exceptions.html
    
Offset 273, 15 lines modifiedOffset 273, 15 lines modified
273 ···········</div>273 ···········</div>
274 ··········</div>274 ··········</div>
275 ··········<footer>275 ··········<footer>
  
276 ··<hr/>276 ··<hr/>
  
277 ··<div·role="contentinfo">277 ··<div·role="contentinfo">
278 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.278 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
279 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.279 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
280 ······</span></p>280 ······</span></p>
281 ··</div>281 ··</div>
  
282 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a282 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
283 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>283 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
284 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.284 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
504 B
html2text {}
    
Offset 188, 9 lines modifiedOffset 188, 9 lines modified
188 _\x8[_\x8d_\x8o_\x8c_\x8s_\x8]188 _\x8[_\x8d_\x8o_\x8c_\x8s_\x8]
189 class·ContractFail(AssertionError):189 class·ContractFail(AssertionError):
190 ····"""Error·raised·in·case·of·a·failing·contract"""190 ····"""Error·raised·in·case·of·a·failing·contract"""
  
191 ····pass191 ····pass
  
192 ===============================================================================192 ===============================================================================
193 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.193 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
194 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.194 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.2 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/exporters.html
    
Offset 547, 15 lines modifiedOffset 547, 15 lines modified
547 ···········</div>547 ···········</div>
548 ··········</div>548 ··········</div>
549 ··········<footer>549 ··········<footer>
  
550 ··<hr/>550 ··<hr/>
  
551 ··<div·role="contentinfo">551 ··<div·role="contentinfo">
552 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.552 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
553 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.553 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
554 ······</span></p>554 ······</span></p>
555 ··</div>555 ··</div>
  
556 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a556 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
557 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>557 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
558 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.558 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
551 B
html2text {}
    
Offset 473, 9 lines modifiedOffset 473, 9 lines modified
473 ············yield·key,·self._serialize_value(value)473 ············yield·key,·self._serialize_value(value)
  
474 ····def·export_item(self,·item):474 ····def·export_item(self,·item):
475 ········result·=·dict(self._get_serialized_fields(item))475 ········result·=·dict(self._get_serialized_fields(item))
476 ········return·result476 ········return·result
  
477 ===============================================================================477 ===============================================================================
478 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.478 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
479 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.479 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.28 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/closespider.html
    
Offset 267, 15 lines modifiedOffset 267, 15 lines modified
267 ···········</div>267 ···········</div>
268 ··········</div>268 ··········</div>
269 ··········<footer>269 ··········<footer>
  
270 ··<hr/>270 ··<hr/>
  
271 ··<div·role="contentinfo">271 ··<div·role="contentinfo">
272 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.272 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
273 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.273 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
274 ······</span></p>274 ······</span></p>
275 ··</div>275 ··</div>
  
276 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a276 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
277 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>277 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
278 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.278 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
611 B
html2text {}
    
Offset 180, 9 lines modifiedOffset 180, 9 lines modified
180 ················f"Closing·spider·since·no·items·were·produced·in·the·last·"180 ················f"Closing·spider·since·no·items·were·produced·in·the·last·"
181 ················f"{self.timeout_no_item}·seconds."181 ················f"{self.timeout_no_item}·seconds."
182 ············)182 ············)
183 ············self.crawler.engine.close_spider(spider,183 ············self.crawler.engine.close_spider(spider,
184 "closespider_timeout_no_item")184 "closespider_timeout_no_item")
  
185 ===============================================================================185 ===============================================================================
186 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.186 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
187 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.187 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.3 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/corestats.html
    
Offset 202, 15 lines modifiedOffset 202, 15 lines modified
202 ···········</div>202 ···········</div>
203 ··········</div>203 ··········</div>
204 ··········<footer>204 ··········<footer>
  
205 ··<hr/>205 ··<hr/>
  
206 ··<div·role="contentinfo">206 ··<div·role="contentinfo">
207 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.207 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
208 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.208 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
209 ······</span></p>209 ······</span></p>
210 ··</div>210 ··</div>
  
211 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a211 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
212 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>212 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
213 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.213 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
635 B
html2text {}
    
Offset 109, 9 lines modifiedOffset 109, 9 lines modified
109 ····def·item_dropped(self,·item,·spider,·exception):109 ····def·item_dropped(self,·item,·spider,·exception):
110 ········reason·=·exception.__class__.__name__110 ········reason·=·exception.__class__.__name__
111 ········self.stats.inc_value("item_dropped_count",·spider=spider)111 ········self.stats.inc_value("item_dropped_count",·spider=spider)
112 ········self.stats.inc_value(f"item_dropped_reasons_count/{reason}",112 ········self.stats.inc_value(f"item_dropped_reasons_count/{reason}",
113 spider=spider)113 spider=spider)
  
114 ===============================================================================114 ===============================================================================
115 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.115 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
116 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.116 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.31 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/feedexport.html
    
Offset 852, 15 lines modifiedOffset 852, 15 lines modified
852 ···········</div>852 ···········</div>
853 ··········</div>853 ··········</div>
854 ··········<footer>854 ··········<footer>
  
855 ··<hr/>855 ··<hr/>
  
856 ··<div·role="contentinfo">856 ··<div·role="contentinfo">
857 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.857 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
858 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.858 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
859 ······</span></p>859 ······</span></p>
860 ··</div>860 ··</div>
  
861 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a861 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
862 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>862 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
863 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.863 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
638 B
html2text {}
    
Offset 794, 9 lines modifiedOffset 794, 9 lines modified
  
794 ····def·_load_filter(self,·feed_options):794 ····def·_load_filter(self,·feed_options):
795 ········#·load·the·item·filter·if·declared·else·load·the·default·filter·class795 ········#·load·the·item·filter·if·declared·else·load·the·default·filter·class
796 ········item_filter_class·=·load_object(feed_options.get("item_filter",796 ········item_filter_class·=·load_object(feed_options.get("item_filter",
797 ItemFilter))797 ItemFilter))
798 ········return·item_filter_class(feed_options)798 ········return·item_filter_class(feed_options)
799 ===============================================================================799 ===============================================================================
800 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.800 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
801 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.801 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.24 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/httpcache.html
    
Offset 547, 15 lines modifiedOffset 547, 15 lines modified
547 ···········</div>547 ···········</div>
548 ··········</div>548 ··········</div>
549 ··········<footer>549 ··········<footer>
  
550 ··<hr/>550 ··<hr/>
  
551 ··<div·role="contentinfo">551 ··<div·role="contentinfo">
552 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.552 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
553 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.553 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
554 ······</span></p>554 ······</span></p>
555 ··</div>555 ··</div>
  
556 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a556 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
557 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>557 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
558 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.558 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
575 B
html2text {}
    
Offset 463, 9 lines modifiedOffset 463, 9 lines modified
463 def·rfc1123_to_epoch(date_str):463 def·rfc1123_to_epoch(date_str):
464 ····try:464 ····try:
465 ········date_str·=·to_unicode(date_str,·encoding="ascii")465 ········date_str·=·to_unicode(date_str,·encoding="ascii")
466 ········return·mktime_tz(parsedate_tz(date_str))466 ········return·mktime_tz(parsedate_tz(date_str))
467 ····except·Exception:467 ····except·Exception:
468 ········return·None468 ········return·None
469 ===============================================================================469 ===============================================================================
470 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.470 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
471 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.471 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.23 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/logstats.html
    
Offset 213, 15 lines modifiedOffset 213, 15 lines modified
213 ···········</div>213 ···········</div>
214 ··········</div>214 ··········</div>
215 ··········<footer>215 ··········<footer>
  
216 ··<hr/>216 ··<hr/>
  
217 ··<div·role="contentinfo">217 ··<div·role="contentinfo">
218 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.218 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
219 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.219 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
220 ······</span></p>220 ······</span></p>
221 ··</div>221 ··</div>
  
222 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a222 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
223 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>223 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
224 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.224 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
566 B
html2text {}
    
Offset 118, 9 lines modifiedOffset 118, 9 lines modified
118 ········logger.info(msg,·log_args,·extra={"spider":·spider})118 ········logger.info(msg,·log_args,·extra={"spider":·spider})
  
119 ····def·spider_closed(self,·spider,·reason):119 ····def·spider_closed(self,·spider,·reason):
120 ········if·self.task·and·self.task.running:120 ········if·self.task·and·self.task.running:
121 ············self.task.stop()121 ············self.task.stop()
  
122 ===============================================================================122 ===============================================================================
123 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.123 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
124 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.124 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.23 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/memdebug.html
    
Offset 191, 15 lines modifiedOffset 191, 15 lines modified
191 ···········</div>191 ···········</div>
192 ··········</div>192 ··········</div>
193 ··········<footer>193 ··········<footer>
  
194 ··<hr/>194 ··<hr/>
  
195 ··<div·role="contentinfo">195 ··<div·role="contentinfo">
196 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.196 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
197 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.197 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
198 ······</span></p>198 ······</span></p>
199 ··</div>199 ··</div>
  
200 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a200 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
201 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>201 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
202 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.202 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
563 B
html2text {}
    
Offset 96, 9 lines modifiedOffset 96, 9 lines modified
96 ············if·not·wdict:96 ············if·not·wdict:
97 ················continue97 ················continue
98 ············self.stats.set_value(98 ············self.stats.set_value(
99 ················f"memdebug/live_refs/{cls.__name__}",·len(wdict),·spider=spider99 ················f"memdebug/live_refs/{cls.__name__}",·len(wdict),·spider=spider
100 ············)100 ············)
  
101 ===============================================================================101 ===============================================================================
102 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.102 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
103 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.103 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.21 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/memusage.html
    
Offset 296, 15 lines modifiedOffset 296, 15 lines modified
296 ···········</div>296 ···········</div>
297 ··········</div>297 ··········</div>
298 ··········<footer>298 ··········<footer>
  
299 ··<hr/>299 ··<hr/>
  
300 ··<div·role="contentinfo">300 ··<div·role="contentinfo">
301 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.301 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
302 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.302 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
303 ······</span></p>303 ······</span></p>
304 ··</div>304 ··</div>
  
305 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a305 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
306 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>306 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
307 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.307 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
539 B
html2text {}
    
Offset 210, 9 lines modifiedOffset 210, 9 lines modified
210 ········)210 ········)
211 ········s·+=·"\r\n"211 ········s·+=·"\r\n"
212 ········s·+=·pformat(get_engine_status(self.crawler.engine))212 ········s·+=·pformat(get_engine_status(self.crawler.engine))
213 ········s·+=·"\r\n"213 ········s·+=·"\r\n"
214 ········self.mail.send(rcpts,·subject,·s)214 ········self.mail.send(rcpts,·subject,·s)
  
215 ===============================================================================215 ===============================================================================
216 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.216 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
217 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.217 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.2 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/periodic_log.html
    
Offset 295, 15 lines modifiedOffset 295, 15 lines modified
295 ···········</div>295 ···········</div>
296 ··········</div>296 ··········</div>
297 ··········<footer>297 ··········<footer>
  
298 ··<hr/>298 ··<hr/>
  
299 ··<div·role="contentinfo">299 ··<div·role="contentinfo">
300 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.300 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
301 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.301 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
302 ······</span></p>302 ······</span></p>
303 ··</div>303 ··</div>
  
304 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a304 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
305 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>305 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
306 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.306 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
524 B
html2text {}
    
Offset 203, 9 lines modifiedOffset 203, 9 lines modified
  
203 ····def·spider_closed(self,·spider,·reason):203 ····def·spider_closed(self,·spider,·reason):
204 ········self.log()204 ········self.log()
205 ········if·self.task·and·self.task.running:205 ········if·self.task·and·self.task.running:
206 ············self.task.stop()206 ············self.task.stop()
  
207 ===============================================================================207 ===============================================================================
208 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.208 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
209 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.209 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.24 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/postprocessing.html
    
Offset 330, 15 lines modifiedOffset 330, 15 lines modified
330 ···········</div>330 ···········</div>
331 ··········</div>331 ··········</div>
332 ··········<footer>332 ··········<footer>
  
333 ··<hr/>333 ··<hr/>
  
334 ··<div·role="contentinfo">334 ··<div·role="contentinfo">
335 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.335 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
336 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.336 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
337 ······</span></p>337 ······</span></p>
338 ··</div>338 ··</div>
  
339 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a339 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
340 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>340 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
341 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.341 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
563 B
html2text {}
    
Offset 243, 9 lines modifiedOffset 243, 9 lines modified
  
243 ····def·_get_head_plugin(self)·->·Any:243 ····def·_get_head_plugin(self)·->·Any:
244 ········prev·=·self.file244 ········prev·=·self.file
245 ········for·plugin·in·self.plugins[::-1]:245 ········for·plugin·in·self.plugins[::-1]:
246 ············prev·=·plugin(prev,·self.feed_options)246 ············prev·=·plugin(prev,·self.feed_options)
247 ········return·prev247 ········return·prev
248 ===============================================================================248 ===============================================================================
249 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.249 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
250 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.250 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.28 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/statsmailer.html
    
Offset 189, 15 lines modifiedOffset 189, 15 lines modified
189 ···········</div>189 ···········</div>
190 ··········</div>190 ··········</div>
191 ··········<footer>191 ··········<footer>
  
192 ··<hr/>192 ··<hr/>
  
193 ··<div·role="contentinfo">193 ··<div·role="contentinfo">
194 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.194 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
195 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.195 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
196 ······</span></p>196 ······</span></p>
197 ··</div>197 ··</div>
  
198 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a198 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
199 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>199 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
200 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.200 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
609 B
html2text {}
    
Offset 96, 9 lines modifiedOffset 96, 9 lines modified
96 ().items())96 ().items())
97 ········body·+=·f"\n\n{spider.name}·stats\n\n"97 ········body·+=·f"\n\n{spider.name}·stats\n\n"
98 ········body·+=·"\n".join(f"{k:<50}·:·{v}"·for·k,·v·in·spider_stats.items())98 ········body·+=·"\n".join(f"{k:<50}·:·{v}"·for·k,·v·in·spider_stats.items())
99 ········return·self.mail.send(self.recipients,·f"Scrapy·stats·for:99 ········return·self.mail.send(self.recipients,·f"Scrapy·stats·for:
100 {spider.name}",·body)100 {spider.name}",·body)
  
101 ===============================================================================101 ===============================================================================
102 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.102 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
103 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.103 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.25 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/telnet.html
    
Offset 270, 15 lines modifiedOffset 270, 15 lines modified
270 ···········</div>270 ···········</div>
271 ··········</div>271 ··········</div>
272 ··········<footer>272 ··········<footer>
  
273 ··<hr/>273 ··<hr/>
  
274 ··<div·role="contentinfo">274 ··<div·role="contentinfo">
275 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.275 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
276 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.276 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
277 ······</span></p>277 ······</span></p>
278 ··</div>278 ··</div>
  
279 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a279 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
280 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>280 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
281 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.281 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
587 B
html2text {}
    
Offset 180, 9 lines modifiedOffset 180, 9 lines modified
180 ············"https://docs.scrapy.org/en/latest/topics/telnetconsole.html",180 ············"https://docs.scrapy.org/en/latest/topics/telnetconsole.html",
181 ········}181 ········}
182 ········self.crawler.signals.send_catch_log(update_telnet_vars,182 ········self.crawler.signals.send_catch_log(update_telnet_vars,
183 telnet_vars=telnet_vars)183 telnet_vars=telnet_vars)
184 ········return·telnet_vars184 ········return·telnet_vars
  
185 ===============================================================================185 ===============================================================================
186 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.186 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
187 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.187 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.19 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/http/request/json_request.html
    
Offset 219, 15 lines modifiedOffset 219, 15 lines modified
219 ···········</div>219 ···········</div>
220 ··········</div>220 ··········</div>
221 ··········<footer>221 ··········<footer>
  
222 ··<hr/>222 ··<hr/>
  
223 ··<div·role="contentinfo">223 ··<div·role="contentinfo">
224 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.224 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
225 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.225 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
226 ······</span></p>226 ······</span></p>
227 ··</div>227 ··</div>
  
228 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a228 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
229 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>229 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
230 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.230 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
509 B
html2text {}
    
Offset 127, 9 lines modifiedOffset 127, 9 lines modified
127 ········return·json.dumps(data,·**self._dumps_kwargs)127 ········return·json.dumps(data,·**self._dumps_kwargs)
  
  
  
  
128 JSONRequest·=·create_deprecated_class("JSONRequest",·JsonRequest)128 JSONRequest·=·create_deprecated_class("JSONRequest",·JsonRequest)
129 ===============================================================================129 ===============================================================================
130 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.130 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
131 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.131 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.32 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/http/request.html
    
Offset 418, 15 lines modifiedOffset 418, 15 lines modified
418 ···········</div>418 ···········</div>
419 ··········</div>419 ··········</div>
420 ··········<footer>420 ··········<footer>
  
421 ··<hr/>421 ··<hr/>
  
422 ··<div·role="contentinfo">422 ··<div·role="contentinfo">
423 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.423 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
424 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.424 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
425 ······</span></p>425 ······</span></p>
426 ··</div>426 ··</div>
  
427 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a427 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
428 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>428 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
429 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.429 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
673 B
html2text {}
    
Offset 342, 9 lines modifiedOffset 342, 9 lines modified
342 ············#342 ············#
343 ············#·Reference:·The·standard·type·hierarchy343 ············#·Reference:·The·standard·type·hierarchy
344 ············#·https://docs.python.org/3/reference/datamodel.html344 ············#·https://docs.python.org/3/reference/datamodel.html
345 ············if·obj_func.__func__·is·func.__func__:345 ············if·obj_func.__func__·is·func.__func__:
346 ················return·name346 ················return·name
347 ····raise·ValueError(f"Function·{func}·is·not·an·instance·method·in:·{obj}")347 ····raise·ValueError(f"Function·{func}·is·not·an·instance·method·in:·{obj}")
348 ===============================================================================348 ===============================================================================
349 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.349 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
350 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.350 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.12 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/http/response/html.html
    
Offset 168, 15 lines modifiedOffset 168, 15 lines modified
168 ···········</div>168 ···········</div>
169 ··········</div>169 ··········</div>
170 ··········<footer>170 ··········<footer>
  
171 ··<hr/>171 ··<hr/>
  
172 ··<div·role="contentinfo">172 ··<div·role="contentinfo">
173 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.173 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
174 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.174 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
175 ······</span></p>175 ······</span></p>
176 ··</div>176 ··</div>
  
177 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a177 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
178 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>178 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
179 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.179 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
448 B
html2text {}
    
Offset 73, 9 lines modifiedOffset 73, 9 lines modified
  
  
73 _\x8[_\x8d_\x8o_\x8c_\x8s_\x8]73 _\x8[_\x8d_\x8o_\x8c_\x8s_\x8]
74 class·HtmlResponse(TextResponse):74 class·HtmlResponse(TextResponse):
75 ····pass75 ····pass
  
76 ===============================================================================76 ===============================================================================
77 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.77 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
78 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.78 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.24 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/http/response/text.html
    
Offset 486, 15 lines modifiedOffset 486, 15 lines modified
486 ···········</div>486 ···········</div>
487 ··········</div>487 ··········</div>
488 ··········<footer>488 ··········<footer>
  
489 ··<hr/>489 ··<hr/>
  
490 ··<div·role="contentinfo">490 ··<div·role="contentinfo">
491 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.491 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
492 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.492 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
493 ······</span></p>493 ······</span></p>
494 ··</div>494 ··</div>
  
495 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a495 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
496 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>496 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
497 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.497 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
577 B
html2text {}
    
Offset 415, 9 lines modifiedOffset 415, 9 lines modified
415 ········)415 ········)
416 ····href·=·sel.root.get("href")416 ····href·=·sel.root.get("href")
417 ····if·href·is·None:417 ····if·href·is·None:
418 ········raise·_InvalidSelector(f"<{sel.root.tag}>·element·has·no·href418 ········raise·_InvalidSelector(f"<{sel.root.tag}>·element·has·no·href
419 attribute:·{sel}")419 attribute:·{sel}")
420 ····return·strip_html5_whitespace(href)420 ····return·strip_html5_whitespace(href)
421 ===============================================================================421 ===============================================================================
422 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.422 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
423 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.423 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.11 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/http/response/xml.html
    
Offset 168, 15 lines modifiedOffset 168, 15 lines modified
168 ···········</div>168 ···········</div>
169 ··········</div>169 ··········</div>
170 ··········<footer>170 ··········<footer>
  
171 ··<hr/>171 ··<hr/>
  
172 ··<div·role="contentinfo">172 ··<div·role="contentinfo">
173 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.173 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
174 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.174 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
175 ······</span></p>175 ······</span></p>
176 ··</div>176 ··</div>
  
177 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a177 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
178 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>178 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
179 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.179 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
447 B
html2text {}
    
Offset 73, 9 lines modifiedOffset 73, 9 lines modified
  
  
73 _\x8[_\x8d_\x8o_\x8c_\x8s_\x8]73 _\x8[_\x8d_\x8o_\x8c_\x8s_\x8]
74 class·XmlResponse(TextResponse):74 class·XmlResponse(TextResponse):
75 ····pass75 ····pass
  
76 ===============================================================================76 ===============================================================================
77 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.77 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
78 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.78 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.12 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/http/response.html
    
Offset 425, 15 lines modifiedOffset 425, 15 lines modified
425 ···········</div>425 ···········</div>
426 ··········</div>426 ··········</div>
427 ··········<footer>427 ··········<footer>
  
428 ··<hr/>428 ··<hr/>
  
429 ··<div·role="contentinfo">429 ··<div·role="contentinfo">
430 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.430 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
431 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.431 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
432 ······</span></p>432 ······</span></p>
433 ··</div>433 ··</div>
  
434 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a434 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
435 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>435 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
436 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.436 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
468 B
html2text {}
    
Offset 338, 9 lines modifiedOffset 338, 9 lines modified
338 ················flags=flags,338 ················flags=flags,
339 ············)339 ············)
340 ············for·url·in·urls340 ············for·url·in·urls
341 ········)341 ········)
  
  
342 ===============================================================================342 ===============================================================================
343 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.343 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
344 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.344 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.19 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/item.html
    
Offset 274, 15 lines modifiedOffset 274, 15 lines modified
274 ···········</div>274 ···········</div>
275 ··········</div>275 ··········</div>
276 ··········<footer>276 ··········<footer>
  
277 ··<hr/>277 ··<hr/>
  
278 ··<div·role="contentinfo">278 ··<div·role="contentinfo">
279 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.279 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
280 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.280 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
281 ······</span></p>281 ······</span></p>
282 ··</div>282 ··</div>
  
283 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a283 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
284 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>284 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
285 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.285 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
556 B
html2text {}
    
Offset 187, 9 lines modifiedOffset 187, 9 lines modified
187 ····def·copy(self):187 ····def·copy(self):
188 ········return·self.__class__(self)188 ········return·self.__class__(self)
  
189 ····def·deepcopy(self):189 ····def·deepcopy(self):
190 ········"""Return·a·:func:`~copy.deepcopy`·of·this·item."""190 ········"""Return·a·:func:`~copy.deepcopy`·of·this·item."""
191 ········return·deepcopy(self)191 ········return·deepcopy(self)
192 ===============================================================================192 ===============================================================================
193 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.193 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
194 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.194 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.21 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/link.html
    
Offset 215, 15 lines modifiedOffset 215, 15 lines modified
215 ···········</div>215 ···········</div>
216 ··········</div>216 ··········</div>
217 ··········<footer>217 ··········<footer>
  
218 ··<hr/>218 ··<hr/>
  
219 ··<div·role="contentinfo">219 ··<div·role="contentinfo">
220 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.220 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
221 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.221 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
222 ······</span></p>222 ······</span></p>
223 ··</div>223 ··</div>
  
224 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a224 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
225 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>225 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
226 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.226 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
574 B
html2text {}
    
Offset 126, 9 lines modifiedOffset 126, 9 lines modified
126 ····def·__repr__(self)·->·str:126 ····def·__repr__(self)·->·str:
127 ········return·(127 ········return·(
128 ············f"Link(url={self.url!r},·text={self.text!r},·"128 ············f"Link(url={self.url!r},·text={self.text!r},·"
129 ············f"fragment={self.fragment!r},·nofollow={self.nofollow!r})"129 ············f"fragment={self.fragment!r},·nofollow={self.nofollow!r})"
130 ········)130 ········)
  
131 ===============================================================================131 ===============================================================================
132 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.132 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
133 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.133 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.22 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/linkextractors/lxmlhtml.html
    
Offset 410, 15 lines modifiedOffset 410, 15 lines modified
410 ···········</div>410 ···········</div>
411 ··········</div>411 ··········</div>
412 ··········<footer>412 ··········<footer>
  
413 ··<hr/>413 ··<hr/>
  
414 ··<div·role="contentinfo">414 ··<div·role="contentinfo">
415 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.415 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
416 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.416 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
417 ······</span></p>417 ······</span></p>
418 ··</div>418 ··</div>
  
419 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a419 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
420 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>420 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
421 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.421 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
550 B
html2text {}
    
Offset 328, 9 lines modifiedOffset 328, 9 lines modified
328 ············all_links.extend(self._process_links(links))328 ············all_links.extend(self._process_links(links))
329 ········if·self.link_extractor.unique:329 ········if·self.link_extractor.unique:
330 ············return·unique_list(all_links)330 ············return·unique_list(all_links)
331 ········return·all_links331 ········return·all_links
  
  
332 ===============================================================================332 ===============================================================================
333 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.333 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
334 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.334 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.22 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/loader.html
    
Offset 246, 15 lines modifiedOffset 246, 15 lines modified
246 ···········</div>246 ···········</div>
247 ··········</div>247 ··········</div>
248 ··········<footer>248 ··········<footer>
  
249 ··<hr/>249 ··<hr/>
  
250 ··<div·role="contentinfo">250 ··<div·role="contentinfo">
251 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.251 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
252 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.252 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
253 ······</span></p>253 ······</span></p>
254 ··</div>254 ··</div>
  
255 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a255 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
256 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>256 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
257 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.257 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
576 B
html2text {}
    
Offset 161, 9 lines modifiedOffset 161, 9 lines modified
161 ············except·AttributeError:161 ············except·AttributeError:
162 ················selector·=·None162 ················selector·=·None
163 ········context.update(response=response)163 ········context.update(response=response)
164 ········super().__init__(item=item,·selector=selector,·parent=parent,164 ········super().__init__(item=item,·selector=selector,·parent=parent,
165 **context)165 **context)
  
166 ===============================================================================166 ===============================================================================
167 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.167 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
168 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.168 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.13 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/logformatter.html
    
Offset 351, 15 lines modifiedOffset 351, 15 lines modified
351 ···········</div>351 ···········</div>
352 ··········</div>352 ··········</div>
353 ··········<footer>353 ··········<footer>
  
354 ··<hr/>354 ··<hr/>
  
355 ··<div·role="contentinfo">355 ··<div·role="contentinfo">
356 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.356 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
357 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.357 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
358 ······</span></p>358 ······</span></p>
359 ··</div>359 ··</div>
  
360 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a360 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
361 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>361 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
362 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.362 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
479 B
html2text {}
    
Offset 279, 9 lines modifiedOffset 279, 9 lines modified
  
  
279 ····@classmethod279 ····@classmethod
280 ····def·from_crawler(cls,·crawler:·Crawler)·->·Self:280 ····def·from_crawler(cls,·crawler:·Crawler)·->·Self:
281 ········return·cls()281 ········return·cls()
  
282 ===============================================================================282 ===============================================================================
283 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.283 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
284 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.284 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.13 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/mail.html
    
Offset 369, 15 lines modifiedOffset 369, 15 lines modified
369 ···········</div>369 ···········</div>
370 ··········</div>370 ··········</div>
371 ··········<footer>371 ··········<footer>
  
372 ··<hr/>372 ··<hr/>
  
373 ··<div·role="contentinfo">373 ··<div·role="contentinfo">
374 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.374 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
375 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.375 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
376 ······</span></p>376 ······</span></p>
377 ··</div>377 ··</div>
  
378 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a378 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
379 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>379 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
380 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.380 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
495 B
html2text {}
    
Offset 278, 9 lines modifiedOffset 278, 9 lines modified
278 ············d,278 ············d,
279 ············**factory_keywords279 ············**factory_keywords
280 ········)280 ········)
281 ········factory.noisy·=·False281 ········factory.noisy·=·False
282 ········return·factory282 ········return·factory
  
283 ===============================================================================283 ===============================================================================
284 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.284 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
285 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.285 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.25 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/pipelines/files.html
    
Offset 716, 15 lines modifiedOffset 716, 15 lines modified
716 ···········</div>716 ···········</div>
717 ··········</div>717 ··········</div>
718 ··········<footer>718 ··········<footer>
  
719 ··<hr/>719 ··<hr/>
  
720 ··<div·role="contentinfo">720 ··<div·role="contentinfo">
721 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.721 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
722 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.722 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
723 ······</span></p>723 ······</span></p>
724 ··</div>724 ··</div>
  
725 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a725 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
726 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>726 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
727 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.727 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
589 B
html2text {}
    
Offset 642, 9 lines modifiedOffset 642, 9 lines modified
642 ············media_type·=·mimetypes.guess_type(request.url)[0]642 ············media_type·=·mimetypes.guess_type(request.url)[0]
643 ············if·media_type:643 ············if·media_type:
644 ················media_ext·=·mimetypes.guess_extension(media_type)644 ················media_ext·=·mimetypes.guess_extension(media_type)
645 ········return·f"full/{media_guid}{media_ext}"645 ········return·f"full/{media_guid}{media_ext}"
  
  
646 ===============================================================================646 ===============================================================================
647 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.647 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
648 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.648 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.25 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/pipelines/images.html
    
Offset 398, 15 lines modifiedOffset 398, 15 lines modified
398 ···········</div>398 ···········</div>
399 ··········</div>399 ··········</div>
400 ··········<footer>400 ··········<footer>
  
401 ··<hr/>401 ··<hr/>
  
402 ··<div·role="contentinfo">402 ··<div·role="contentinfo">
403 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.403 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
404 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.404 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
405 ······</span></p>405 ······</span></p>
406 ··</div>406 ··</div>
  
407 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a407 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
408 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>408 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
409 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.409 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
594 B
html2text {}
    
Offset 317, 9 lines modifiedOffset 317, 9 lines modified
317 ····def·thumb_path(self,·request,·thumb_id,·response=None,·info=None,·*,317 ····def·thumb_path(self,·request,·thumb_id,·response=None,·info=None,·*,
318 item=None):318 item=None):
319 ········thumb_guid·=·hashlib.sha1(to_bytes(request.url)).hexdigest()319 ········thumb_guid·=·hashlib.sha1(to_bytes(request.url)).hexdigest()
320 ········return·f"thumbs/{thumb_id}/{thumb_guid}.jpg"320 ········return·f"thumbs/{thumb_id}/{thumb_guid}.jpg"
  
  
321 ===============================================================================321 ===============================================================================
322 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.322 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
323 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.323 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.21 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/robotstxt.html
    
Offset 296, 15 lines modifiedOffset 296, 15 lines modified
296 ···········</div>296 ···········</div>
297 ··········</div>297 ··········</div>
298 ··········<footer>298 ··········<footer>
  
299 ··<hr/>299 ··<hr/>
  
300 ··<div·role="contentinfo">300 ··<div·role="contentinfo">
301 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.301 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
302 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.302 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
303 ······</span></p>303 ······</span></p>
304 ··</div>304 ··</div>
  
305 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a305 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
306 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>306 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
307 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.307 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
567 B
html2text {}
    
Offset 208, 9 lines modifiedOffset 208, 9 lines modified
208 ········return·o208 ········return·o
  
209 ····def·allowed(self,·url,·user_agent):209 ····def·allowed(self,·url,·user_agent):
210 ········user_agent·=·to_unicode(user_agent)210 ········user_agent·=·to_unicode(user_agent)
211 ········url·=·to_unicode(url)211 ········url·=·to_unicode(url)
212 ········return·self.rp.can_fetch(url,·user_agent)212 ········return·self.rp.can_fetch(url,·user_agent)
213 ===============================================================================213 ===============================================================================
214 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.214 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
215 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.215 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.17 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/selector/unified.html
    
Offset 255, 15 lines modifiedOffset 255, 15 lines modified
255 ···········</div>255 ···········</div>
256 ··········</div>256 ··········</div>
257 ··········<footer>257 ··········<footer>
  
258 ··<hr/>258 ··<hr/>
  
259 ··<div·role="contentinfo">259 ··<div·role="contentinfo">
260 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.260 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
261 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.261 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
262 ······</span></p>262 ······</span></p>
263 ··</div>263 ··</div>
  
264 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a264 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
265 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>265 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
266 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.266 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
510 B
html2text {}
    
Offset 164, 9 lines modifiedOffset 164, 9 lines modified
  
164 ········if·root·is·not·_NOT_SET:164 ········if·root·is·not·_NOT_SET:
165 ············kwargs["root"]·=·root165 ············kwargs["root"]·=·root
  
166 ········super().__init__(text=text,·type=st,·**kwargs)166 ········super().__init__(text=text,·type=st,·**kwargs)
  
167 ===============================================================================167 ===============================================================================
168 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.168 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
169 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.169 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.31 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/settings.html
    
Offset 788, 15 lines modifiedOffset 788, 15 lines modified
788 ···········</div>788 ···········</div>
789 ··········</div>789 ··········</div>
790 ··········<footer>790 ··········<footer>
  
791 ··<hr/>791 ··<hr/>
  
792 ··<div·role="contentinfo">792 ··<div·role="contentinfo">
793 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.793 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
794 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.794 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
795 ······</span></p>795 ······</span></p>
796 ··</div>796 ··</div>
  
797 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a797 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
798 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>798 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
799 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.799 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
665 B
html2text {}
    
Offset 729, 9 lines modifiedOffset 729, 9 lines modified
729 )·->·Iterable[Tuple[str,·Any]]:729 )·->·Iterable[Tuple[str,·Any]]:
730 ····"""Return·an·iterable·of·the·settings·that·have·been·overridden"""730 ····"""Return·an·iterable·of·the·settings·that·have·been·overridden"""
731 ····for·name,·defvalue·in·iter_default_settings():731 ····for·name,·defvalue·in·iter_default_settings():
732 ········value·=·settings[name]732 ········value·=·settings[name]
733 ········if·not·isinstance(defvalue,·dict)·and·value·!=·defvalue:733 ········if·not·isinstance(defvalue,·dict)·and·value·!=·defvalue:
734 ············yield·name,·value734 ············yield·name,·value
735 ===============================================================================735 ===============================================================================
736 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.736 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
737 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.737 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.18 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/signalmanager.html
    
Offset 241, 15 lines modifiedOffset 241, 15 lines modified
241 ···········</div>241 ···········</div>
242 ··········</div>242 ··········</div>
243 ··········<footer>243 ··········<footer>
  
244 ··<hr/>244 ··<hr/>
  
245 ··<div·role="contentinfo">245 ··<div·role="contentinfo">
246 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.246 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
247 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.247 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
248 ······</span></p>248 ······</span></p>
249 ··</div>249 ··</div>
  
250 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a250 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
251 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>251 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
252 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.252 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
526 B
html2text {}
    
Offset 151, 9 lines modifiedOffset 151, 9 lines modified
151 ········:type·signal:·object151 ········:type·signal:·object
152 ········"""152 ········"""
153 ········kwargs.setdefault("sender",·self.sender)153 ········kwargs.setdefault("sender",·self.sender)
154 ········_signal.disconnect_all(signal,·**kwargs)154 ········_signal.disconnect_all(signal,·**kwargs)
  
  
155 ===============================================================================155 ===============================================================================
156 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.156 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
157 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.157 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.18 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/spiderloader.html
    
Offset 270, 15 lines modifiedOffset 270, 15 lines modified
270 ···········</div>270 ···········</div>
271 ··········</div>271 ··········</div>
272 ··········<footer>272 ··········<footer>
  
273 ··<hr/>273 ··<hr/>
  
274 ··<div·role="contentinfo">274 ··<div·role="contentinfo">
275 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.275 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
276 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.276 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
277 ······</span></p>277 ······</span></p>
278 ··</div>278 ··</div>
  
279 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a279 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
280 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>280 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
281 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.281 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
531 B
html2text {}
    
Offset 180, 9 lines modifiedOffset 180, 9 lines modified
180 ········"""180 ········"""
181 ········Return·a·list·with·the·names·of·all·spiders·available·in·the·project.181 ········Return·a·list·with·the·names·of·all·spiders·available·in·the·project.
182 ········"""182 ········"""
183 ········return·list(self._spiders.keys())183 ········return·list(self._spiders.keys())
  
  
184 ===============================================================================184 ===============================================================================
185 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.185 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
186 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.186 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.29 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/spidermiddlewares/depth.html
    
Offset 218, 15 lines modifiedOffset 218, 15 lines modified
218 ···········</div>218 ···········</div>
219 ··········</div>219 ··········</div>
220 ··········<footer>220 ··········<footer>
  
221 ··<hr/>221 ··<hr/>
  
222 ··<div·role="contentinfo">222 ··<div·role="contentinfo">
223 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.223 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
224 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.224 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
225 ······</span></p>225 ······</span></p>
226 ··</div>226 ··</div>
  
227 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a227 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
228 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>228 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
229 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.229 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
614 B
html2text {}
    
Offset 123, 9 lines modifiedOffset 123, 9 lines modified
123 ············return·False123 ············return·False
124 ········if·self.verbose_stats:124 ········if·self.verbose_stats:
125 ············self.stats.inc_value(f"request_depth_count/{depth}",·spider=spider)125 ············self.stats.inc_value(f"request_depth_count/{depth}",·spider=spider)
126 ········self.stats.max_value("request_depth_max",·depth,·spider=spider)126 ········self.stats.max_value("request_depth_max",·depth,·spider=spider)
127 ········return·True127 ········return·True
  
128 ===============================================================================128 ===============================================================================
129 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.129 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
130 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.130 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.21 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/spidermiddlewares/httperror.html
    
Offset 214, 15 lines modifiedOffset 214, 15 lines modified
214 ···········</div>214 ···········</div>
215 ··········</div>215 ··········</div>
216 ··········<footer>216 ··········<footer>
  
217 ··<hr/>217 ··<hr/>
  
218 ··<div·role="contentinfo">218 ··<div·role="contentinfo">
219 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.219 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
220 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.220 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
221 ······</span></p>221 ······</span></p>
222 ··</div>222 ··</div>
  
223 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a223 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
224 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>224 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
225 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.225 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
529 B
html2text {}
    
Offset 121, 9 lines modifiedOffset 121, 9 lines modified
121 handled·or·not·allowed",121 handled·or·not·allowed",
122 ················{"response":·response},122 ················{"response":·response},
123 ················extra={"spider":·spider},123 ················extra={"spider":·spider},
124 ············)124 ············)
125 ············return·[]125 ············return·[]
  
126 ===============================================================================126 ===============================================================================
127 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.127 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
128 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.128 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.14 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/spidermiddlewares/offsite.html
    
Offset 251, 15 lines modifiedOffset 251, 15 lines modified
251 ···········</div>251 ···········</div>
252 ··········</div>252 ··········</div>
253 ··········<footer>253 ··········<footer>
  
254 ··<hr/>254 ··<hr/>
  
255 ··<div·role="contentinfo">255 ··<div·role="contentinfo">
256 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.256 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
257 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.257 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
258 ······</span></p>258 ······</span></p>
259 ··</div>259 ··</div>
  
260 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a260 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
261 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>261 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
262 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.262 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
460 B
html2text {}
    
Offset 157, 9 lines modifiedOffset 157, 9 lines modified
157 class·URLWarning(Warning):157 class·URLWarning(Warning):
158 ····pass158 ····pass
  
  
159 class·PortWarning(Warning):159 class·PortWarning(Warning):
160 ····pass160 ····pass
161 ===============================================================================161 ===============================================================================
162 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.162 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
163 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.163 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.32 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/spidermiddlewares/referer.html
    
Offset 567, 15 lines modifiedOffset 567, 15 lines modified
567 ···········</div>567 ···········</div>
568 ··········</div>568 ··········</div>
569 ··········<footer>569 ··········<footer>
  
570 ··<hr/>570 ··<hr/>
  
571 ··<div·role="contentinfo">571 ··<div·role="contentinfo">
572 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.572 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
573 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.573 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
574 ······</span></p>574 ······</span></p>
575 ··</div>575 ··</div>
  
576 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a576 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
577 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>577 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
578 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.578 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
640 B
html2text {}
    
Offset 503, 9 lines modifiedOffset 503, 9 lines modified
503 ················if·policy_referrer·!=·request_referrer:503 ················if·policy_referrer·!=·request_referrer:
504 ····················if·policy_referrer·is·None:504 ····················if·policy_referrer·is·None:
505 ························request.headers.pop("Referer")505 ························request.headers.pop("Referer")
506 ····················else:506 ····················else:
507 ························request.headers["Referer"]·=·policy_referrer507 ························request.headers["Referer"]·=·policy_referrer
  
508 ===============================================================================508 ===============================================================================
509 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.509 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
510 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.510 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.24 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/spidermiddlewares/urllength.html
    
Offset 200, 15 lines modifiedOffset 200, 15 lines modified
200 ···········</div>200 ···········</div>
201 ··········</div>201 ··········</div>
202 ··········<footer>202 ··········<footer>
  
203 ··<hr/>203 ··<hr/>
  
204 ··<div·role="contentinfo">204 ··<div·role="contentinfo">
205 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.205 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
206 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.206 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
207 ······</span></p>207 ······</span></p>
208 ··</div>208 ··</div>
  
209 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a209 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
210 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>210 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
211 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.211 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
554 B
html2text {}
    
Offset 105, 9 lines modifiedOffset 105, 9 lines modified
105 ············spider.crawler.stats.inc_value(105 ············spider.crawler.stats.inc_value(
106 ················"urllength/request_ignored_count",·spider=spider106 ················"urllength/request_ignored_count",·spider=spider
107 ············)107 ············)
108 ············return·False108 ············return·False
109 ········return·True109 ········return·True
  
110 ===============================================================================110 ===============================================================================
111 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.111 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
112 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.112 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.24 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/spiders/crawl.html
    
Offset 310, 15 lines modifiedOffset 310, 15 lines modified
310 ···········</div>310 ···········</div>
311 ··········</div>311 ··········</div>
312 ··········<footer>312 ··········<footer>
  
313 ··<hr/>313 ··<hr/>
  
314 ··<div·role="contentinfo">314 ··<div·role="contentinfo">
315 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.315 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
316 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.316 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
317 ······</span></p>317 ······</span></p>
318 ··</div>318 ··</div>
  
319 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a319 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
320 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>320 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
321 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.321 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
584 B
html2text {}
    
Offset 219, 9 lines modifiedOffset 219, 9 lines modified
219 ········spider·=·super().from_crawler(crawler,·*args,·**kwargs)219 ········spider·=·super().from_crawler(crawler,·*args,·**kwargs)
220 ········spider._follow_links·=·crawler.settings.getbool(220 ········spider._follow_links·=·crawler.settings.getbool(
221 ············"CRAWLSPIDER_FOLLOW_LINKS",·True221 ············"CRAWLSPIDER_FOLLOW_LINKS",·True
222 ········)222 ········)
223 ········return·spider223 ········return·spider
  
224 ===============================================================================224 ===============================================================================
225 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.225 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
226 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.226 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.23 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/spiders/feed.html
    
Offset 315, 15 lines modifiedOffset 315, 15 lines modified
315 ···········</div>315 ···········</div>
316 ··········</div>316 ··········</div>
317 ··········<footer>317 ··········<footer>
  
318 ··<hr/>318 ··<hr/>
  
319 ··<div·role="contentinfo">319 ··<div·role="contentinfo">
320 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.320 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
321 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.321 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
322 ······</span></p>322 ······</span></p>
323 ··</div>323 ··</div>
  
324 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a324 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
325 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>325 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
326 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.326 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
574 B
html2text {}
    
Offset 233, 9 lines modifiedOffset 233, 9 lines modified
233 ················"You·must·define·parse_row·method·in·order·to·scrape·this·CSV233 ················"You·must·define·parse_row·method·in·order·to·scrape·this·CSV
234 feed"234 feed"
235 ············)235 ············)
236 ········response·=·self.adapt_response(response)236 ········response·=·self.adapt_response(response)
237 ········return·self.parse_rows(response)237 ········return·self.parse_rows(response)
  
238 ===============================================================================238 ===============================================================================
239 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.239 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
240 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.240 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.23 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/spiders/sitemap.html
    
Offset 291, 15 lines modifiedOffset 291, 15 lines modified
291 ···········</div>291 ···········</div>
292 ··········</div>292 ··········</div>
293 ··········<footer>293 ··········<footer>
  
294 ··<hr/>294 ··<hr/>
  
295 ··<div·role="contentinfo">295 ··<div·role="contentinfo">
296 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.296 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
297 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.297 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
298 ······</span></p>298 ······</span></p>
299 ··</div>299 ··</div>
  
300 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a300 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
301 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>301 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
302 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.302 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
569 B
html2text {}
    
Offset 204, 9 lines modifiedOffset 204, 9 lines modified
204 ····for·d·in·it:204 ····for·d·in·it:
205 ········yield·d["loc"]205 ········yield·d["loc"]
  
206 ········#·Also·consider·alternate·URLs·(xhtml:link·rel="alternate")206 ········#·Also·consider·alternate·URLs·(xhtml:link·rel="alternate")
207 ········if·alt·and·"alternate"·in·d:207 ········if·alt·and·"alternate"·in·d:
208 ············yield·from·d["alternate"]208 ············yield·from·d["alternate"]
209 ===============================================================================209 ===============================================================================
210 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.210 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
211 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.211 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.16 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/statscollectors.html
    
Offset 289, 15 lines modifiedOffset 289, 15 lines modified
289 ···········</div>289 ···········</div>
290 ··········</div>290 ··········</div>
291 ··········<footer>291 ··········<footer>
  
292 ··<hr/>292 ··<hr/>
  
293 ··<div·role="contentinfo">293 ··<div·role="contentinfo">
294 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.294 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
295 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.295 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
296 ······</span></p>296 ······</span></p>
297 ··</div>297 ··</div>
  
298 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a298 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
299 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>299 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
300 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.300 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
501 B
html2text {}
    
Offset 216, 9 lines modifiedOffset 216, 9 lines modified
216 ········pass216 ········pass
  
217 ····def·min_value(self,·key:·str,·value:·Any,·spider:·Optional[Spider]·=·None)217 ····def·min_value(self,·key:·str,·value:·Any,·spider:·Optional[Spider]·=·None)
218 ->·None:218 ->·None:
219 ········pass219 ········pass
  
220 ===============================================================================220 ===============================================================================
221 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.221 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
222 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.222 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.21 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/utils/curl.html
    
Offset 271, 15 lines modifiedOffset 271, 15 lines modified
271 ···········</div>271 ···········</div>
272 ··········</div>272 ··········</div>
273 ··········<footer>273 ··········<footer>
  
274 ··<hr/>274 ··<hr/>
  
275 ··<div·role="contentinfo">275 ··<div·role="contentinfo">
276 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.276 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
277 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.277 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
278 ······</span></p>278 ······</span></p>
279 ··</div>279 ··</div>
  
280 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a280 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
281 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>281 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
282 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.282 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
562 B
html2text {}
    
Offset 177, 9 lines modifiedOffset 177, 9 lines modified
177 ············#·if·the·"data"·is·specified·but·the·"method"·is·not·specified,177 ············#·if·the·"data"·is·specified·but·the·"method"·is·not·specified,
178 ············#·the·default·method·is·'POST'178 ············#·the·default·method·is·'POST'
179 ············result["method"]·=·"POST"179 ············result["method"]·=·"POST"
  
180 ····return·result180 ····return·result
  
181 ===============================================================================181 ===============================================================================
182 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.182 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
183 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.183 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.22 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/utils/defer.html
    
Offset 569, 15 lines modifiedOffset 569, 15 lines modified
569 ···········</div>569 ···········</div>
570 ··········</div>570 ··········</div>
571 ··········<footer>571 ··········<footer>
  
572 ··<hr/>572 ··<hr/>
  
573 ··<div·role="contentinfo">573 ··<div·role="contentinfo">
574 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.574 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
575 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.575 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
576 ······</span></p>576 ······</span></p>
577 ··</div>577 ··</div>
  
578 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a578 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
579 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>579 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
580 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.580 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
566 B
html2text {}
    
Offset 506, 9 lines modifiedOffset 506, 9 lines modified
506 ················additional_response·=·await·maybe_deferred_to_future(deferred)506 ················additional_response·=·await·maybe_deferred_to_future(deferred)
507 ····"""507 ····"""
508 ····if·not·is_asyncio_reactor_installed():508 ····if·not·is_asyncio_reactor_installed():
509 ········return·d509 ········return·d
510 ····return·deferred_to_future(d)510 ····return·deferred_to_future(d)
  
511 ===============================================================================511 ===============================================================================
512 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.512 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
513 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.513 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.3 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/utils/iterators.html
    
Offset 417, 15 lines modifiedOffset 417, 15 lines modified
417 ···········</div>417 ···········</div>
418 ··········</div>418 ··········</div>
419 ··········<footer>419 ··········<footer>
  
420 ··<hr/>420 ··<hr/>
  
421 ··<div·role="contentinfo">421 ··<div·role="contentinfo">
422 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.422 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
423 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.423 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
424 ······</span></p>424 ······</span></p>
425 ··</div>425 ··</div>
  
426 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a426 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
427 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>427 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
428 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.428 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
643 B
html2text {}
    
Offset 330, 9 lines modifiedOffset 330, 9 lines modified
330 ········if·isinstance(obj,·TextResponse):330 ········if·isinstance(obj,·TextResponse):
331 ············return·obj.text331 ············return·obj.text
332 ········return·cast(bytes,·obj.body).decode("utf-8")332 ········return·cast(bytes,·obj.body).decode("utf-8")
333 ····if·isinstance(obj,·str):333 ····if·isinstance(obj,·str):
334 ········return·obj·if·unicode·else·obj.encode("utf-8")334 ········return·obj·if·unicode·else·obj.encode("utf-8")
335 ····return·obj.decode("utf-8")·if·unicode·else·obj335 ····return·obj.decode("utf-8")·if·unicode·else·obj
336 ===============================================================================336 ===============================================================================
337 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.337 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
338 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.338 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.29 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/utils/log.html
    
Offset 406, 15 lines modifiedOffset 406, 15 lines modified
406 ···········</div>406 ···········</div>
407 ··········</div>407 ··········</div>
408 ··········<footer>408 ··········<footer>
  
409 ··<hr/>409 ··<hr/>
  
410 ··<div·role="contentinfo">410 ··<div·role="contentinfo">
411 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.411 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
412 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.412 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
413 ······</span></p>413 ······</span></p>
414 ··</div>414 ··</div>
  
415 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a415 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
416 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>416 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
417 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.417 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
650 B
html2text {}
    
Offset 319, 9 lines modifiedOffset 319, 9 lines modified
319 ····message·=·logkws.get("format",·logkws.get("msg"))319 ····message·=·logkws.get("format",·logkws.get("msg"))
320 ····#·NOTE:·This·also·handles·'args'·being·an·empty·dict,·that·case·doesn't320 ····#·NOTE:·This·also·handles·'args'·being·an·empty·dict,·that·case·doesn't
321 ····#·play·well·in·logger.log·calls321 ····#·play·well·in·logger.log·calls
322 ····args·=·logkws·if·not·logkws.get("args")·else·logkws["args"]322 ····args·=·logkws·if·not·logkws.get("args")·else·logkws["args"]
  
323 ····return·(level,·message,·args)323 ····return·(level,·message,·args)
324 ===============================================================================324 ===============================================================================
325 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.325 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
326 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.326 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.2 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/utils/reactor.html
    
Offset 343, 15 lines modifiedOffset 343, 15 lines modified
343 ···········</div>343 ···········</div>
344 ··········</div>344 ··········</div>
345 ··········<footer>345 ··········<footer>
  
346 ··<hr/>346 ··<hr/>
  
347 ··<div·role="contentinfo">347 ··<div·role="contentinfo">
348 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.348 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
349 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.349 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
350 ······</span></p>350 ······</span></p>
351 ··</div>351 ··</div>
  
352 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a352 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
353 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>353 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
354 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.354 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
543 B
html2text {}
    
Offset 253, 9 lines modifiedOffset 253, 9 lines modified
  
  
253 def·is_asyncio_reactor_installed()·->·bool:253 def·is_asyncio_reactor_installed()·->·bool:
254 ····from·twisted.internet·import·reactor254 ····from·twisted.internet·import·reactor
  
255 ····return·isinstance(reactor,·asyncioreactor.AsyncioSelectorReactor)255 ····return·isinstance(reactor,·asyncioreactor.AsyncioSelectorReactor)
256 ===============================================================================256 ===============================================================================
257 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.257 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
258 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.258 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.23 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/utils/request.html
    
Offset 543, 15 lines modifiedOffset 543, 15 lines modified
543 ···········</div>543 ···········</div>
544 ··········</div>544 ··········</div>
545 ··········<footer>545 ··········<footer>
  
546 ··<hr/>546 ··<hr/>
  
547 ··<div·role="contentinfo">547 ··<div·role="contentinfo">
548 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.548 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
549 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.549 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
550 ······</span></p>550 ······</span></p>
551 ··</div>551 ··</div>
  
552 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a552 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
553 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>553 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
554 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.554 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
575 B
html2text {}
    
Offset 462, 9 lines modifiedOffset 462, 9 lines modified
462 request.cookies462 request.cookies
463 ············)463 ············)
464 ············cookies·=·f"--cookie·'{cookie}'"464 ············cookies·=·f"--cookie·'{cookie}'"
  
465 ····curl_cmd·=·f"curl·-X·{method}·{url}·{data}·{headers}·{cookies}".strip()465 ····curl_cmd·=·f"curl·-X·{method}·{url}·{data}·{headers}·{cookies}".strip()
466 ····return·"·".join(curl_cmd.split())466 ····return·"·".join(curl_cmd.split())
467 ===============================================================================467 ===============================================================================
468 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.468 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
469 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.469 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.19 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/utils/response.html
    
Offset 284, 15 lines modifiedOffset 284, 15 lines modified
284 ···········</div>284 ···········</div>
285 ··········</div>285 ··········</div>
286 ··········<footer>286 ··········<footer>
  
287 ··<hr/>287 ··<hr/>
  
288 ··<div·role="contentinfo">288 ··<div·role="contentinfo">
289 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.289 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
290 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.290 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
291 ······</span></p>291 ······</span></p>
292 ··</div>292 ··</div>
  
293 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a293 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
294 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>294 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
295 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.295 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
536 B
html2text {}
    
Offset 192, 9 lines modifiedOffset 192, 9 lines modified
192 {response.__class__.__name__}")192 {response.__class__.__name__}")
193 ····fd,·fname·=·tempfile.mkstemp(ext)193 ····fd,·fname·=·tempfile.mkstemp(ext)
194 ····os.write(fd,·body)194 ····os.write(fd,·body)
195 ····os.close(fd)195 ····os.close(fd)
196 ····return·_openfunc(f"file://{fname}")196 ····return·_openfunc(f"file://{fname}")
  
197 ===============================================================================197 ===============================================================================
198 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.198 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
199 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.199 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.24 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/utils/trackref.html
    
Offset 236, 15 lines modifiedOffset 236, 15 lines modified
236 ···········</div>236 ···········</div>
237 ··········</div>237 ··········</div>
238 ··········<footer>238 ··········<footer>
  
239 ··<hr/>239 ··<hr/>
  
240 ··<div·role="contentinfo">240 ··<div·role="contentinfo">
241 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.241 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
242 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.242 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
243 ······</span></p>243 ······</span></p>
244 ··</div>244 ··</div>
  
245 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a245 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
246 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>246 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
247 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.247 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
583 B
html2text {}
    
Offset 146, 9 lines modifiedOffset 146, 9 lines modified
146 ····"""Iterate·over·all·objects·of·the·same·class·by·its·class·name"""146 ····"""Iterate·over·all·objects·of·the·same·class·by·its·class·name"""
147 ····for·cls,·wdict·in·live_refs.items():147 ····for·cls,·wdict·in·live_refs.items():
148 ········if·cls.__name__·==·class_name:148 ········if·cls.__name__·==·class_name:
149 ············return·wdict.keys()149 ············return·wdict.keys()
150 ····return·[]150 ····return·[]
  
151 ===============================================================================151 ===============================================================================
152 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.152 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
153 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.153 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.56 KB
./usr/share/doc/python-scrapy-doc/html/contributing.html
    
Offset 425, 15 lines modifiedOffset 425, 15 lines modified
425 ········<a·href="news.html"·class="btn·btn-neutral·float-left"·title="Release·notes"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>425 ········<a·href="news.html"·class="btn·btn-neutral·float-left"·title="Release·notes"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
426 ········<a·href="versioning.html"·class="btn·btn-neutral·float-right"·title="Versioning·and·API·stability"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>426 ········<a·href="versioning.html"·class="btn·btn-neutral·float-right"·title="Versioning·and·API·stability"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
427 ····</div>427 ····</div>
  
428 ··<hr/>428 ··<hr/>
  
429 ··<div·role="contentinfo">429 ··<div·role="contentinfo">
430 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.430 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
431 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.431 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
432 ······</span></p>432 ······</span></p>
433 ··</div>433 ··</div>
  
434 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a434 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
435 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>435 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
436 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.436 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
599 B
html2text {}
    
Offset 255, 9 lines modifiedOffset 255, 9 lines modified
255 name·typically·resembles·the·full·path·of·the·module·they’re·testing.·For255 name·typically·resembles·the·full·path·of·the·module·they’re·testing.·For
256 example,·the·item·loaders·code·is·in:256 example,·the·item·loaders·code·is·in:
257 scrapy.loader257 scrapy.loader
258 And·their·unit-tests·are·in:258 And·their·unit-tests·are·in:
259 tests/test_loader.py259 tests/test_loader.py
260 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t260 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
261 ===============================================================================261 ===============================================================================
262 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.262 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
263 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.263 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.97 KB
./usr/share/doc/python-scrapy-doc/html/faq.html
    
Offset 541, 15 lines modifiedOffset 541, 15 lines modified
541 ········<a·href="topics/telnetconsole.html"·class="btn·btn-neutral·float-left"·title="Telnet·Console"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>541 ········<a·href="topics/telnetconsole.html"·class="btn·btn-neutral·float-left"·title="Telnet·Console"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
542 ········<a·href="topics/debug.html"·class="btn·btn-neutral·float-right"·title="Debugging·Spiders"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>542 ········<a·href="topics/debug.html"·class="btn·btn-neutral·float-right"·title="Debugging·Spiders"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
543 ····</div>543 ····</div>
  
544 ··<hr/>544 ··<hr/>
  
545 ··<div·role="contentinfo">545 ··<div·role="contentinfo">
546 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.546 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
547 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.547 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
548 ······</span></p>548 ······</span></p>
549 ··</div>549 ··</div>
  
550 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a550 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
551 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>551 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
552 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.552 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
1020 B
html2text {}
    
Offset 332, 9 lines modifiedOffset 332, 9 lines modified
332 additional·information·and·examples.332 additional·information·and·examples.
333 *\x8**\x8**\x8**\x8**\x8*·R\x8Ru\x8un\x8nn\x8ni\x8in\x8ng\x8g·r\x8ru\x8un\x8ns\x8sp\x8pi\x8id\x8de\x8er\x8r·I\x8I·g\x8ge\x8et\x8t·e\x8er\x8rr\x8ro\x8or\x8r:\x8:·N\x8No\x8o·s\x8sp\x8pi\x8id\x8de\x8er\x8r·f\x8fo\x8ou\x8un\x8nd\x8d·i\x8in\x8n·f\x8fi\x8il\x8le\x8e:\x8:·<\x8<f\x8fi\x8il\x8le\x8en\x8na\x8am\x8me\x8e>\x8>_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*333 *\x8**\x8**\x8**\x8**\x8*·R\x8Ru\x8un\x8nn\x8ni\x8in\x8ng\x8g·r\x8ru\x8un\x8ns\x8sp\x8pi\x8id\x8de\x8er\x8r·I\x8I·g\x8ge\x8et\x8t·e\x8er\x8rr\x8ro\x8or\x8r:\x8:·N\x8No\x8o·s\x8sp\x8pi\x8id\x8de\x8er\x8r·f\x8fo\x8ou\x8un\x8nd\x8d·i\x8in\x8n·f\x8fi\x8il\x8le\x8e:\x8:·<\x8<f\x8fi\x8il\x8le\x8en\x8na\x8am\x8me\x8e>\x8>_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*
334 This·may·happen·if·your·Scrapy·project·has·a·spider·module·with·a·name·that334 This·may·happen·if·your·Scrapy·project·has·a·spider·module·with·a·name·that
335 conflicts·with·the·name·of·one·of·the·_\x8P_\x8y_\x8t_\x8h_\x8o_\x8n_\x8·_\x8s_\x8t_\x8a_\x8n_\x8d_\x8a_\x8r_\x8d_\x8·_\x8l_\x8i_\x8b_\x8r_\x8a_\x8r_\x8y_\x8·_\x8m_\x8o_\x8d_\x8u_\x8l_\x8e_\x8s,·such·as335 conflicts·with·the·name·of·one·of·the·_\x8P_\x8y_\x8t_\x8h_\x8o_\x8n_\x8·_\x8s_\x8t_\x8a_\x8n_\x8d_\x8a_\x8r_\x8d_\x8·_\x8l_\x8i_\x8b_\x8r_\x8a_\x8r_\x8y_\x8·_\x8m_\x8o_\x8d_\x8u_\x8l_\x8e_\x8s,·such·as
336 csv.py·or·os.py,·or·any·_\x8P_\x8y_\x8t_\x8h_\x8o_\x8n_\x8·_\x8p_\x8a_\x8c_\x8k_\x8a_\x8g_\x8e·that·you·have·installed.·See·_\x8i_\x8s_\x8s_\x8u_\x8e_\x8·_\x82_\x86_\x88_\x80.336 csv.py·or·os.py,·or·any·_\x8P_\x8y_\x8t_\x8h_\x8o_\x8n_\x8·_\x8p_\x8a_\x8c_\x8k_\x8a_\x8g_\x8e·that·you·have·installed.·See·_\x8i_\x8s_\x8s_\x8u_\x8e_\x8·_\x82_\x86_\x88_\x80.
337 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t337 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
338 ===============================================================================338 ===============================================================================
339 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.339 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
340 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.340 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.92 KB
./usr/share/doc/python-scrapy-doc/html/genindex.html
    
Offset 3957, 15 lines modifiedOffset 3957, 15 lines modified
3957 ···········</div>3957 ···········</div>
3958 ··········</div>3958 ··········</div>
3959 ··········<footer>3959 ··········<footer>
  
3960 ··<hr/>3960 ··<hr/>
  
3961 ··<div·role="contentinfo">3961 ··<div·role="contentinfo">
3962 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.3962 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
3963 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.3963 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
3964 ······</span></p>3964 ······</span></p>
3965 ··</div>3965 ··</div>
  
3966 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a3966 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
3967 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>3967 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
3968 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.3968 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
1.29 KB
html2text {}
    
Offset 1089, 9 lines modifiedOffset 1089, 9 lines modified
1089 ····*·_\x8X_\x8M_\x8L_\x8F_\x8e_\x8e_\x8d_\x8S_\x8p_\x8i_\x8d_\x8e_\x8r_\x8·_\x8(_\x8c_\x8l_\x8a_\x8s_\x8s_\x8·_\x8i_\x8n·······*·_\x8X_\x8m_\x8l_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e_\x8·_\x8(_\x8c_\x8l_\x8a_\x8s_\x8s_\x8·_\x8i_\x8n_\x8·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8h_\x8t_\x8t_\x8p_\x8)1089 ····*·_\x8X_\x8M_\x8L_\x8F_\x8e_\x8e_\x8d_\x8S_\x8p_\x8i_\x8d_\x8e_\x8r_\x8·_\x8(_\x8c_\x8l_\x8a_\x8s_\x8s_\x8·_\x8i_\x8n·······*·_\x8X_\x8m_\x8l_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e_\x8·_\x8(_\x8c_\x8l_\x8a_\x8s_\x8s_\x8·_\x8i_\x8n_\x8·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8h_\x8t_\x8t_\x8p_\x8)
1090 ······_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8p_\x8i_\x8d_\x8e_\x8r_\x8s_\x8)···············*·_\x8x_\x8p_\x8a_\x8t_\x8h_\x8(_\x8)_\x8·_\x8(_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8h_\x8t_\x8t_\x8p_\x8._\x8T_\x8e_\x8x_\x8t_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e1090 ······_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8p_\x8i_\x8d_\x8e_\x8r_\x8s_\x8)···············*·_\x8x_\x8p_\x8a_\x8t_\x8h_\x8(_\x8)_\x8·_\x8(_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8h_\x8t_\x8t_\x8p_\x8._\x8T_\x8e_\x8x_\x8t_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e
1091 ····*·_\x8X_\x8m_\x8l_\x8I_\x8t_\x8e_\x8m_\x8E_\x8x_\x8p_\x8o_\x8r_\x8t_\x8e_\x8r_\x8·_\x8(_\x8c_\x8l_\x8a_\x8s_\x8s_\x8·_\x8i_\x8n·······_\x8m_\x8e_\x8t_\x8h_\x8o_\x8d_\x8)1091 ····*·_\x8X_\x8m_\x8l_\x8I_\x8t_\x8e_\x8m_\x8E_\x8x_\x8p_\x8o_\x8r_\x8t_\x8e_\x8r_\x8·_\x8(_\x8c_\x8l_\x8a_\x8s_\x8s_\x8·_\x8i_\x8n·······_\x8m_\x8e_\x8t_\x8h_\x8o_\x8d_\x8)
1092 ······_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8e_\x8x_\x8p_\x8o_\x8r_\x8t_\x8e_\x8r_\x8s_\x8)···················o·_\x8(_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8e_\x8l_\x8e_\x8c_\x8t_\x8o_\x8r_\x8._\x8S_\x8e_\x8l_\x8e_\x8c_\x8t_\x8o_\x8r_\x8·_\x8m_\x8e_\x8t_\x8h_\x8o_\x8d_\x8)1092 ······_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8e_\x8x_\x8p_\x8o_\x8r_\x8t_\x8e_\x8r_\x8s_\x8)···················o·_\x8(_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8e_\x8l_\x8e_\x8c_\x8t_\x8o_\x8r_\x8._\x8S_\x8e_\x8l_\x8e_\x8c_\x8t_\x8o_\x8r_\x8·_\x8m_\x8e_\x8t_\x8h_\x8o_\x8d_\x8)
1093 ····*·_\x8x_\x8m_\x8l_\x8i_\x8t_\x8e_\x8r_\x8__\x8l_\x8x_\x8m_\x8l_\x8(_\x8)_\x8·_\x8(_\x8i_\x8n_\x8·_\x8m_\x8o_\x8d_\x8u_\x8l_\x8e···········o·_\x8(_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8e_\x8l_\x8e_\x8c_\x8t_\x8o_\x8r_\x8._\x8S_\x8e_\x8l_\x8e_\x8c_\x8t_\x8o_\x8r_\x8L_\x8i_\x8s_\x8t1093 ····*·_\x8x_\x8m_\x8l_\x8i_\x8t_\x8e_\x8r_\x8__\x8l_\x8x_\x8m_\x8l_\x8(_\x8)_\x8·_\x8(_\x8i_\x8n_\x8·_\x8m_\x8o_\x8d_\x8u_\x8l_\x8e···········o·_\x8(_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8e_\x8l_\x8e_\x8c_\x8t_\x8o_\x8r_\x8._\x8S_\x8e_\x8l_\x8e_\x8c_\x8t_\x8o_\x8r_\x8L_\x8i_\x8s_\x8t
1094 ······_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8i_\x8t_\x8e_\x8r_\x8a_\x8t_\x8o_\x8r_\x8s_\x8)···············_\x8m_\x8e_\x8t_\x8h_\x8o_\x8d_\x8)1094 ······_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8i_\x8t_\x8e_\x8r_\x8a_\x8t_\x8o_\x8r_\x8s_\x8)···············_\x8m_\x8e_\x8t_\x8h_\x8o_\x8d_\x8)
1095 ===============================================================================1095 ===============================================================================
1096 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.1096 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
1097 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.1097 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.56 KB
./usr/share/doc/python-scrapy-doc/html/index.html
    
Offset 315, 15 lines modifiedOffset 315, 15 lines modified
315 ··········<footer><div·class="rst-footer-buttons"·role="navigation"·aria-label="Footer">315 ··········<footer><div·class="rst-footer-buttons"·role="navigation"·aria-label="Footer">
316 ········<a·href="intro/overview.html"·class="btn·btn-neutral·float-right"·title="Scrapy·at·a·glance"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>316 ········<a·href="intro/overview.html"·class="btn·btn-neutral·float-right"·title="Scrapy·at·a·glance"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
317 ····</div>317 ····</div>
  
318 ··<hr/>318 ··<hr/>
  
319 ··<div·role="contentinfo">319 ··<div·role="contentinfo">
320 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.320 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
321 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.321 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
322 ······</span></p>322 ······</span></p>
323 ··</div>323 ··</div>
  
324 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a324 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
325 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>325 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
326 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.326 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
715 B
html2text {}
    
Offset 174, 9 lines modifiedOffset 174, 9 lines modified
174 ······See·what·has·changed·in·recent·Scrapy·versions.174 ······See·what·has·changed·in·recent·Scrapy·versions.
175 ··_\x8C_\x8o_\x8n_\x8t_\x8r_\x8i_\x8b_\x8u_\x8t_\x8i_\x8n_\x8g_\x8·_\x8t_\x8o_\x8·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y175 ··_\x8C_\x8o_\x8n_\x8t_\x8r_\x8i_\x8b_\x8u_\x8t_\x8i_\x8n_\x8g_\x8·_\x8t_\x8o_\x8·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y
176 ······Learn·how·to·contribute·to·the·Scrapy·project.176 ······Learn·how·to·contribute·to·the·Scrapy·project.
177 ··_\x8V_\x8e_\x8r_\x8s_\x8i_\x8o_\x8n_\x8i_\x8n_\x8g_\x8·_\x8a_\x8n_\x8d_\x8·_\x8A_\x8P_\x8I_\x8·_\x8s_\x8t_\x8a_\x8b_\x8i_\x8l_\x8i_\x8t_\x8y177 ··_\x8V_\x8e_\x8r_\x8s_\x8i_\x8o_\x8n_\x8i_\x8n_\x8g_\x8·_\x8a_\x8n_\x8d_\x8·_\x8A_\x8P_\x8I_\x8·_\x8s_\x8t_\x8a_\x8b_\x8i_\x8l_\x8i_\x8t_\x8y
178 ······Understand·Scrapy·versioning·and·API·stability.178 ······Understand·Scrapy·versioning·and·API·stability.
179 _\x8N_\x8e_\x8x_\x8t179 _\x8N_\x8e_\x8x_\x8t
180 ===============================================================================180 ===============================================================================
181 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.181 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
182 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.182 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.76 KB
./usr/share/doc/python-scrapy-doc/html/intro/examples.html
    
Offset 170, 15 lines modifiedOffset 170, 15 lines modified
170 ········<a·href="tutorial.html"·class="btn·btn-neutral·float-left"·title="Scrapy·Tutorial"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>170 ········<a·href="tutorial.html"·class="btn·btn-neutral·float-left"·title="Scrapy·Tutorial"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
171 ········<a·href="../topics/commands.html"·class="btn·btn-neutral·float-right"·title="Command·line·tool"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>171 ········<a·href="../topics/commands.html"·class="btn·btn-neutral·float-right"·title="Command·line·tool"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
172 ····</div>172 ····</div>
  
173 ··<hr/>173 ··<hr/>
  
174 ··<div·role="contentinfo">174 ··<div·role="contentinfo">
175 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.175 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
176 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.176 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
177 ······</span></p>177 ······</span></p>
178 ··</div>178 ··</div>
  
179 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a179 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
180 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>180 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
181 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.181 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
797 B
html2text {}
    
Offset 67, 9 lines modifiedOffset 67, 9 lines modified
67 expressions.67 expressions.
68 The·_\x8q_\x8u_\x8o_\x8t_\x8e_\x8s_\x8b_\x8o_\x8t·project·is·available·at:·_\x8h_\x8t_\x8t_\x8p_\x8s_\x8:_\x8/_\x8/_\x8g_\x8i_\x8t_\x8h_\x8u_\x8b_\x8._\x8c_\x8o_\x8m_\x8/_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8/_\x8q_\x8u_\x8o_\x8t_\x8e_\x8s_\x8b_\x8o_\x8t.·You68 The·_\x8q_\x8u_\x8o_\x8t_\x8e_\x8s_\x8b_\x8o_\x8t·project·is·available·at:·_\x8h_\x8t_\x8t_\x8p_\x8s_\x8:_\x8/_\x8/_\x8g_\x8i_\x8t_\x8h_\x8u_\x8b_\x8._\x8c_\x8o_\x8m_\x8/_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8/_\x8q_\x8u_\x8o_\x8t_\x8e_\x8s_\x8b_\x8o_\x8t.·You
69 can·find·more·information·about·it·in·the·project’s·README.69 can·find·more·information·about·it·in·the·project’s·README.
70 If·you’re·familiar·with·git,·you·can·checkout·the·code.·Otherwise·you·can70 If·you’re·familiar·with·git,·you·can·checkout·the·code.·Otherwise·you·can
71 download·the·project·as·a·zip·file·by·clicking·_\x8h_\x8e_\x8r_\x8e.71 download·the·project·as·a·zip·file·by·clicking·_\x8h_\x8e_\x8r_\x8e.
72 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t72 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
73 ===============================================================================73 ===============================================================================
74 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.74 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
75 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.75 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.65 KB
./usr/share/doc/python-scrapy-doc/html/intro/install.html
    
Offset 404, 15 lines modifiedOffset 404, 15 lines modified
404 ········<a·href="overview.html"·class="btn·btn-neutral·float-left"·title="Scrapy·at·a·glance"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>404 ········<a·href="overview.html"·class="btn·btn-neutral·float-left"·title="Scrapy·at·a·glance"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
405 ········<a·href="tutorial.html"·class="btn·btn-neutral·float-right"·title="Scrapy·Tutorial"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>405 ········<a·href="tutorial.html"·class="btn·btn-neutral·float-right"·title="Scrapy·Tutorial"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
406 ····</div>406 ····</div>
  
407 ··<hr/>407 ··<hr/>
  
408 ··<div·role="contentinfo">408 ··<div·role="contentinfo">
409 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.409 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
410 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.410 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
411 ······</span></p>411 ······</span></p>
412 ··</div>412 ··</div>
  
413 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a413 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
414 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>414 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
415 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.415 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
692 B
html2text {}
    
Offset 224, 9 lines modifiedOffset 224, 9 lines modified
224 has·a·version·of·pyOpenSSL·that·your·version·of·Twisted·does·not·support.224 has·a·version·of·pyOpenSSL·that·your·version·of·Twisted·does·not·support.
225 To·install·a·version·of·pyOpenSSL·that·your·version·of·Twisted·supports,225 To·install·a·version·of·pyOpenSSL·that·your·version·of·Twisted·supports,
226 reinstall·Twisted·with·the·tls·extra·option:226 reinstall·Twisted·with·the·tls·extra·option:
227 pip·install·twisted[tls]227 pip·install·twisted[tls]
228 For·details,·see·_\x8I_\x8s_\x8s_\x8u_\x8e_\x8·_\x8#_\x82_\x84_\x87_\x83.228 For·details,·see·_\x8I_\x8s_\x8s_\x8u_\x8e_\x8·_\x8#_\x82_\x84_\x87_\x83.
229 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t229 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
230 ===============================================================================230 ===============================================================================
231 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.231 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
232 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.232 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.79 KB
./usr/share/doc/python-scrapy-doc/html/intro/overview.html
    
Offset 292, 15 lines modifiedOffset 292, 15 lines modified
292 ········<a·href="../index.html"·class="btn·btn-neutral·float-left"·title="Scrapy·2.11·documentation"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>292 ········<a·href="../index.html"·class="btn·btn-neutral·float-left"·title="Scrapy·2.11·documentation"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
293 ········<a·href="install.html"·class="btn·btn-neutral·float-right"·title="Installation·guide"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>293 ········<a·href="install.html"·class="btn·btn-neutral·float-right"·title="Installation·guide"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
294 ····</div>294 ····</div>
  
295 ··<hr/>295 ··<hr/>
  
296 ··<div·role="contentinfo">296 ··<div·role="contentinfo">
297 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.297 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
298 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.298 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
299 ······</span></p>299 ······</span></p>
300 ··</div>300 ··</div>
  
301 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a301 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
302 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>302 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
303 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.303 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
819 B
html2text {}
    
Offset 166, 9 lines modifiedOffset 166, 9 lines modified
166 ······resolver,·and·much·more!166 ······resolver,·and·much·more!
167 *\x8**\x8**\x8**\x8**\x8*·W\x8Wh\x8ha\x8at\x8t?\x8’s\x8s·n\x8ne\x8ex\x8xt\x8t?\x8?_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*167 *\x8**\x8**\x8**\x8**\x8*·W\x8Wh\x8ha\x8at\x8t?\x8’s\x8s·n\x8ne\x8ex\x8xt\x8t?\x8?_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*
168 The·next·steps·for·you·are·to·_\x8i_\x8n_\x8s_\x8t_\x8a_\x8l_\x8l_\x8·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y,·_\x8f_\x8o_\x8l_\x8l_\x8o_\x8w_\x8·_\x8t_\x8h_\x8r_\x8o_\x8u_\x8g_\x8h_\x8·_\x8t_\x8h_\x8e_\x8·_\x8t_\x8u_\x8t_\x8o_\x8r_\x8i_\x8a_\x8l·to168 The·next·steps·for·you·are·to·_\x8i_\x8n_\x8s_\x8t_\x8a_\x8l_\x8l_\x8·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y,·_\x8f_\x8o_\x8l_\x8l_\x8o_\x8w_\x8·_\x8t_\x8h_\x8r_\x8o_\x8u_\x8g_\x8h_\x8·_\x8t_\x8h_\x8e_\x8·_\x8t_\x8u_\x8t_\x8o_\x8r_\x8i_\x8a_\x8l·to
169 learn·how·to·create·a·full-blown·Scrapy·project·and·_\x8j_\x8o_\x8i_\x8n_\x8·_\x8t_\x8h_\x8e_\x8·_\x8c_\x8o_\x8m_\x8m_\x8u_\x8n_\x8i_\x8t_\x8y.·Thanks169 learn·how·to·create·a·full-blown·Scrapy·project·and·_\x8j_\x8o_\x8i_\x8n_\x8·_\x8t_\x8h_\x8e_\x8·_\x8c_\x8o_\x8m_\x8m_\x8u_\x8n_\x8i_\x8t_\x8y.·Thanks
170 for·your·interest!170 for·your·interest!
171 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t171 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
172 ===============================================================================172 ===============================================================================
173 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.173 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
174 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.174 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.74 KB
./usr/share/doc/python-scrapy-doc/html/intro/tutorial.html
    
Offset 865, 15 lines modifiedOffset 865, 15 lines modified
865 ········<a·href="install.html"·class="btn·btn-neutral·float-left"·title="Installation·guide"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>865 ········<a·href="install.html"·class="btn·btn-neutral·float-left"·title="Installation·guide"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
866 ········<a·href="examples.html"·class="btn·btn-neutral·float-right"·title="Examples"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>866 ········<a·href="examples.html"·class="btn·btn-neutral·float-right"·title="Examples"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
867 ····</div>867 ····</div>
  
868 ··<hr/>868 ··<hr/>
  
869 ··<div·role="contentinfo">869 ··<div·role="contentinfo">
870 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.870 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
871 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.871 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
872 ······</span></p>872 ······</span></p>
873 ··</div>873 ··</div>
  
874 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a874 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
875 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>875 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
876 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.876 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
786 B
html2text {}
    
Offset 631, 9 lines modifiedOffset 631, 9 lines modified
631 chapter·for·a·quick·overview·of·the·most·important·ones.631 chapter·for·a·quick·overview·of·the·most·important·ones.
632 You·can·continue·from·the·section·_\x8B_\x8a_\x8s_\x8i_\x8c_\x8·_\x8c_\x8o_\x8n_\x8c_\x8e_\x8p_\x8t_\x8s·to·know·more·about·the632 You·can·continue·from·the·section·_\x8B_\x8a_\x8s_\x8i_\x8c_\x8·_\x8c_\x8o_\x8n_\x8c_\x8e_\x8p_\x8t_\x8s·to·know·more·about·the
633 command-line·tool,·spiders,·selectors·and·other·things·the·tutorial·hasn’t633 command-line·tool,·spiders,·selectors·and·other·things·the·tutorial·hasn’t
634 covered·like·modeling·the·scraped·data.·If·you·prefer·to·play·with·an·example634 covered·like·modeling·the·scraped·data.·If·you·prefer·to·play·with·an·example
635 project,·check·the·_\x8E_\x8x_\x8a_\x8m_\x8p_\x8l_\x8e_\x8s·section.635 project,·check·the·_\x8E_\x8x_\x8a_\x8m_\x8p_\x8l_\x8e_\x8s·section.
636 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t636 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
637 ===============================================================================637 ===============================================================================
638 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.638 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
639 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.639 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.7 KB
./usr/share/doc/python-scrapy-doc/html/news.html
    
Offset 6028, 15 lines modifiedOffset 6028, 15 lines modified
6028 ········<a·href="topics/api.html"·class="btn·btn-neutral·float-left"·title="Core·API"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>6028 ········<a·href="topics/api.html"·class="btn·btn-neutral·float-left"·title="Core·API"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
6029 ········<a·href="contributing.html"·class="btn·btn-neutral·float-right"·title="Contributing·to·Scrapy"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>6029 ········<a·href="contributing.html"·class="btn·btn-neutral·float-right"·title="Contributing·to·Scrapy"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
6030 ····</div>6030 ····</div>
  
6031 ··<hr/>6031 ··<hr/>
  
6032 ··<div·role="contentinfo">6032 ··<div·role="contentinfo">
6033 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.6033 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
6034 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.6034 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
6035 ······</span></p>6035 ······</span></p>
6036 ··</div>6036 ··</div>
  
6037 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a6037 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
6038 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>6038 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
6039 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.6039 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
756 B
html2text {}
    
Offset 4329, 9 lines modifiedOffset 4329, 9 lines modified
4329 ····*·Renamed·extension:·DelayedCloseDomain·to·SpiderCloseDelay·(_\x8r_\x81_\x88_\x86_\x81·|·#121)4329 ····*·Renamed·extension:·DelayedCloseDomain·to·SpiderCloseDelay·(_\x8r_\x81_\x88_\x86_\x81·|·#121)
4330 ····*·Removed·obsolete·scrapy.utils.markup.remove_escape_chars·function·-·use4330 ····*·Removed·obsolete·scrapy.utils.markup.remove_escape_chars·function·-·use
4331 ······scrapy.utils.markup.replace_escape_chars·instead·(_\x8r_\x81_\x88_\x86_\x85)4331 ······scrapy.utils.markup.replace_escape_chars·instead·(_\x8r_\x81_\x88_\x86_\x85)
4332 *\x8**\x8**\x8**\x8**\x8*·S\x8Sc\x8cr\x8ra\x8ap\x8py\x8y·0\x80.\x8.7\x87_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*4332 *\x8**\x8**\x8**\x8**\x8*·S\x8Sc\x8cr\x8ra\x8ap\x8py\x8y·0\x80.\x8.7\x87_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*
4333 First·release·of·Scrapy.4333 First·release·of·Scrapy.
4334 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t4334 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
4335 ===============================================================================4335 ===============================================================================
4336 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.4336 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
4337 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.4337 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.86 KB
./usr/share/doc/python-scrapy-doc/html/py-modindex.html
    
Offset 441, 15 lines modifiedOffset 441, 15 lines modified
441 ···········</div>441 ···········</div>
442 ··········</div>442 ··········</div>
443 ··········<footer>443 ··········<footer>
  
444 ··<hr/>444 ··<hr/>
  
445 ··<div·role="contentinfo">445 ··<div·role="contentinfo">
446 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.446 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
447 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.447 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
448 ······</span></p>448 ······</span></p>
449 ··</div>449 ··</div>
  
450 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a450 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
451 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>451 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
452 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.452 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
1.22 KB
html2text {}
    
Offset 123, 9 lines modifiedOffset 123, 9 lines modified
123 ····   ·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8p_\x8i_\x8d_\x8e_\x8r_\x8m_\x8i_\x8d_\x8d_\x8l_\x8e_\x8w_\x8a_\x8r_\x8e_\x8s_\x8._\x8r_\x8e_\x8f_\x8e_\x8r_\x8e_\x8r·········R\x8Re\x8ef\x8fe\x8er\x8re\x8er\x8r·S\x8Sp\x8pi\x8id\x8de\x8er\x8r·M\x8Mi\x8id\x8dd\x8dl\x8le\x8ew\x8wa\x8ar\x8re\x8e123 ····   ·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8p_\x8i_\x8d_\x8e_\x8r_\x8m_\x8i_\x8d_\x8d_\x8l_\x8e_\x8w_\x8a_\x8r_\x8e_\x8s_\x8._\x8r_\x8e_\x8f_\x8e_\x8r_\x8e_\x8r·········R\x8Re\x8ef\x8fe\x8er\x8re\x8er\x8r·S\x8Sp\x8pi\x8id\x8de\x8er\x8r·M\x8Mi\x8id\x8dd\x8dl\x8le\x8ew\x8wa\x8ar\x8re\x8e
124 ····   ·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8p_\x8i_\x8d_\x8e_\x8r_\x8m_\x8i_\x8d_\x8d_\x8l_\x8e_\x8w_\x8a_\x8r_\x8e_\x8s_\x8._\x8u_\x8r_\x8l_\x8l_\x8e_\x8n_\x8g_\x8t_\x8h·······U\x8UR\x8RL\x8L·L\x8Le\x8en\x8ng\x8gt\x8th\x8h·S\x8Sp\x8pi\x8id\x8de\x8er\x8r·M\x8Mi\x8id\x8dd\x8dl\x8le\x8ew\x8wa\x8ar\x8re\x8e124 ····   ·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8p_\x8i_\x8d_\x8e_\x8r_\x8m_\x8i_\x8d_\x8d_\x8l_\x8e_\x8w_\x8a_\x8r_\x8e_\x8s_\x8._\x8u_\x8r_\x8l_\x8l_\x8e_\x8n_\x8g_\x8t_\x8h·······U\x8UR\x8RL\x8L·L\x8Le\x8en\x8ng\x8gt\x8th\x8h·S\x8Sp\x8pi\x8id\x8de\x8er\x8r·M\x8Mi\x8id\x8dd\x8dl\x8le\x8ew\x8wa\x8ar\x8re\x8e
125 ····   ·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8t_\x8a_\x8t_\x8s_\x8c_\x8o_\x8l_\x8l_\x8e_\x8c_\x8t_\x8o_\x8r_\x8s···················S\x8St\x8ta\x8at\x8ts\x8s·C\x8Co\x8ol\x8ll\x8le\x8ec\x8ct\x8to\x8or\x8rs\x8s125 ····   ·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8t_\x8a_\x8t_\x8s_\x8c_\x8o_\x8l_\x8l_\x8e_\x8c_\x8t_\x8o_\x8r_\x8s···················S\x8St\x8ta\x8at\x8ts\x8s·C\x8Co\x8ol\x8ll\x8le\x8ec\x8ct\x8to\x8or\x8rs\x8s
126 ····   ·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8l_\x8o_\x8g·························L\x8Lo\x8og\x8gg\x8gi\x8in\x8ng\x8g·u\x8ut\x8ti\x8il\x8ls\x8s126 ····   ·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8l_\x8o_\x8g·························L\x8Lo\x8og\x8gg\x8gi\x8in\x8ng\x8g·u\x8ut\x8ti\x8il\x8ls\x8s
127 ····   ·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8t_\x8r_\x8a_\x8c_\x8k_\x8r_\x8e_\x8f····················T\x8Tr\x8ra\x8ac\x8ck\x8k·r\x8re\x8ef\x8fe\x8er\x8re\x8en\x8nc\x8ce\x8es\x8s·o\x8of\x8f·l\x8li\x8iv\x8ve\x8e127 ····   ·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8t_\x8r_\x8a_\x8c_\x8k_\x8r_\x8e_\x8f····················T\x8Tr\x8ra\x8ac\x8ck\x8k·r\x8re\x8ef\x8fe\x8er\x8re\x8en\x8nc\x8ce\x8es\x8s·o\x8of\x8f·l\x8li\x8iv\x8ve\x8e
128 ·················································o\x8ob\x8bj\x8je\x8ec\x8ct\x8ts\x8s128 ·················································o\x8ob\x8bj\x8je\x8ec\x8ct\x8ts\x8s
129 ===============================================================================129 ===============================================================================
130 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.130 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
131 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.131 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.33 KB
./usr/share/doc/python-scrapy-doc/html/search.html
    
Offset 164, 15 lines modifiedOffset 164, 15 lines modified
164 ···········</div>164 ···········</div>
165 ··········</div>165 ··········</div>
166 ··········<footer>166 ··········<footer>
  
167 ··<hr/>167 ··<hr/>
  
168 ··<div·role="contentinfo">168 ··<div·role="contentinfo">
169 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.169 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
170 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.170 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
171 ······</span></p>171 ······</span></p>
172 ··</div>172 ··</div>
  
173 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a173 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
174 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>174 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
175 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.175 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
722 B
html2text {}
    
Offset 56, 9 lines modifiedOffset 56, 9 lines modified
56 ····*·_\x8C_\x8o_\x8n_\x8t_\x8r_\x8i_\x8b_\x8u_\x8t_\x8i_\x8n_\x8g_\x8·_\x8t_\x8o_\x8·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y56 ····*·_\x8C_\x8o_\x8n_\x8t_\x8r_\x8i_\x8b_\x8u_\x8t_\x8i_\x8n_\x8g_\x8·_\x8t_\x8o_\x8·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y
57 ····*·_\x8V_\x8e_\x8r_\x8s_\x8i_\x8o_\x8n_\x8i_\x8n_\x8g_\x8·_\x8a_\x8n_\x8d_\x8·_\x8A_\x8P_\x8I_\x8·_\x8s_\x8t_\x8a_\x8b_\x8i_\x8l_\x8i_\x8t_\x8y57 ····*·_\x8V_\x8e_\x8r_\x8s_\x8i_\x8o_\x8n_\x8i_\x8n_\x8g_\x8·_\x8a_\x8n_\x8d_\x8·_\x8A_\x8P_\x8I_\x8·_\x8s_\x8t_\x8a_\x8b_\x8i_\x8l_\x8i_\x8t_\x8y
58 _\x8S_\x8c_\x8r_\x8a_\x8p_\x8y58 _\x8S_\x8c_\x8r_\x8a_\x8p_\x8y
59 ····*·Search59 ····*·Search
60 ===============================================================================60 ===============================================================================
61 Please·activate·JavaScript·to·enable·the·search·functionality.61 Please·activate·JavaScript·to·enable·the·search·functionality.
62 ===============================================================================62 ===============================================================================
63 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.63 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
64 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.64 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.61 KB
./usr/share/doc/python-scrapy-doc/html/topics/addons.html
    
Offset 347, 15 lines modifiedOffset 347, 15 lines modified
347 ········<a·href="architecture.html"·class="btn·btn-neutral·float-left"·title="Architecture·overview"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>347 ········<a·href="architecture.html"·class="btn·btn-neutral·float-left"·title="Architecture·overview"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
348 ········<a·href="downloader-middleware.html"·class="btn·btn-neutral·float-right"·title="Downloader·Middleware"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>348 ········<a·href="downloader-middleware.html"·class="btn·btn-neutral·float-right"·title="Downloader·Middleware"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
349 ····</div>349 ····</div>
  
350 ··<hr/>350 ··<hr/>
  
351 ··<div·role="contentinfo">351 ··<div·role="contentinfo">
352 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.352 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
353 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.353 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
354 ······</span></p>354 ······</span></p>
355 ··</div>355 ··</div>
  
356 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a356 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
357 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>357 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
358 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.358 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
623 B
html2text {}
    
Offset 201, 9 lines modifiedOffset 201, 9 lines modified
201 ················FALLBACK_SETTING,201 ················FALLBACK_SETTING,
202 ················settings.getwithbase("DOWNLOAD_HANDLERS")["https"],202 ················settings.getwithbase("DOWNLOAD_HANDLERS")["https"],
203 ················"addon",203 ················"addon",
204 ············)204 ············)
205 ········settings["DOWNLOAD_HANDLERS"]["https"]·=·MyHandler205 ········settings["DOWNLOAD_HANDLERS"]["https"]·=·MyHandler
206 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t206 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
207 ===============================================================================207 ===============================================================================
208 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.208 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
209 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.209 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.68 KB
./usr/share/doc/python-scrapy-doc/html/topics/api.html
    
Offset 1065, 15 lines modifiedOffset 1065, 15 lines modified
1065 ········<a·href="components.html"·class="btn·btn-neutral·float-left"·title="Components"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>1065 ········<a·href="components.html"·class="btn·btn-neutral·float-left"·title="Components"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
1066 ········<a·href="../news.html"·class="btn·btn-neutral·float-right"·title="Release·notes"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>1066 ········<a·href="../news.html"·class="btn·btn-neutral·float-right"·title="Release·notes"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
1067 ····</div>1067 ····</div>
  
1068 ··<hr/>1068 ··<hr/>
  
1069 ··<div·role="contentinfo">1069 ··<div·role="contentinfo">
1070 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.1070 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
1071 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.1071 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
1072 ······</span></p>1072 ······</span></p>
1073 ··</div>1073 ··</div>
  
1074 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a1074 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
1075 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>1075 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
1076 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.1076 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
737 B
html2text {}
    
Offset 581, 9 lines modifiedOffset 581, 9 lines modified
581 ········open_spider(s\x8sp\x8pi\x8id\x8de\x8er\x8r)_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x8581 ········open_spider(s\x8sp\x8pi\x8id\x8de\x8er\x8r)_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x8
582 ············Open·the·given·spider·for·stats·collection.582 ············Open·the·given·spider·for·stats·collection.
583 ········close_spider(s\x8sp\x8pi\x8id\x8de\x8er\x8r)_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x8583 ········close_spider(s\x8sp\x8pi\x8id\x8de\x8er\x8r)_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x8
584 ············Close·the·given·spider.·After·this·is·called,·no·more·specific584 ············Close·the·given·spider.·After·this·is·called,·no·more·specific
585 ············stats·can·be·accessed·or·collected.585 ············stats·can·be·accessed·or·collected.
586 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t586 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
587 ===============================================================================587 ===============================================================================
588 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.588 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
589 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.589 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.76 KB
./usr/share/doc/python-scrapy-doc/html/topics/architecture.html
    
Offset 302, 15 lines modifiedOffset 302, 15 lines modified
302 ········<a·href="asyncio.html"·class="btn·btn-neutral·float-left"·title="asyncio"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>302 ········<a·href="asyncio.html"·class="btn·btn-neutral·float-left"·title="asyncio"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
303 ········<a·href="addons.html"·class="btn·btn-neutral·float-right"·title="Add-ons"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>303 ········<a·href="addons.html"·class="btn·btn-neutral·float-right"·title="Add-ons"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
304 ····</div>304 ····</div>
  
305 ··<hr/>305 ··<hr/>
  
306 ··<div·role="contentinfo">306 ··<div·role="contentinfo">
307 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.307 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
308 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.308 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
309 ······</span></p>309 ······</span></p>
310 ··</div>310 ··</div>
  
311 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a311 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
312 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>312 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
313 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.313 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
810 B
html2text {}
    
Offset 153, 9 lines modifiedOffset 153, 9 lines modified
153 For·more·information·about·asynchronous·programming·and·Twisted·see·these153 For·more·information·about·asynchronous·programming·and·Twisted·see·these
154 links:154 links:
155 ····*·_\x8I_\x8n_\x8t_\x8r_\x8o_\x8d_\x8u_\x8c_\x8t_\x8i_\x8o_\x8n_\x8·_\x8t_\x8o_\x8·_\x8D_\x8e_\x8f_\x8e_\x8r_\x8r_\x8e_\x8d_\x8s155 ····*·_\x8I_\x8n_\x8t_\x8r_\x8o_\x8d_\x8u_\x8c_\x8t_\x8i_\x8o_\x8n_\x8·_\x8t_\x8o_\x8·_\x8D_\x8e_\x8f_\x8e_\x8r_\x8r_\x8e_\x8d_\x8s
156 ····*·_\x8T_\x8w_\x8i_\x8s_\x8t_\x8e_\x8d_\x8·_\x8-_\x8·_\x8h_\x8e_\x8l_\x8l_\x8o_\x8,_\x8·_\x8a_\x8s_\x8y_\x8n_\x8c_\x8h_\x8r_\x8o_\x8n_\x8o_\x8u_\x8s_\x8·_\x8p_\x8r_\x8o_\x8g_\x8r_\x8a_\x8m_\x8m_\x8i_\x8n_\x8g156 ····*·_\x8T_\x8w_\x8i_\x8s_\x8t_\x8e_\x8d_\x8·_\x8-_\x8·_\x8h_\x8e_\x8l_\x8l_\x8o_\x8,_\x8·_\x8a_\x8s_\x8y_\x8n_\x8c_\x8h_\x8r_\x8o_\x8n_\x8o_\x8u_\x8s_\x8·_\x8p_\x8r_\x8o_\x8g_\x8r_\x8a_\x8m_\x8m_\x8i_\x8n_\x8g
157 ····*·_\x8T_\x8w_\x8i_\x8s_\x8t_\x8e_\x8d_\x8·_\x8I_\x8n_\x8t_\x8r_\x8o_\x8d_\x8u_\x8c_\x8t_\x8i_\x8o_\x8n_\x8·_\x8-_\x8·_\x8K_\x8r_\x8o_\x8n_\x8d_\x8o157 ····*·_\x8T_\x8w_\x8i_\x8s_\x8t_\x8e_\x8d_\x8·_\x8I_\x8n_\x8t_\x8r_\x8o_\x8d_\x8u_\x8c_\x8t_\x8i_\x8o_\x8n_\x8·_\x8-_\x8·_\x8K_\x8r_\x8o_\x8n_\x8d_\x8o
158 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t158 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
159 ===============================================================================159 ===============================================================================
160 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.160 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
161 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.161 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.75 KB
./usr/share/doc/python-scrapy-doc/html/topics/asyncio.html
    
Offset 330, 15 lines modifiedOffset 330, 15 lines modified
330 ········<a·href="coroutines.html"·class="btn·btn-neutral·float-left"·title="Coroutines"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>330 ········<a·href="coroutines.html"·class="btn·btn-neutral·float-left"·title="Coroutines"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
331 ········<a·href="architecture.html"·class="btn·btn-neutral·float-right"·title="Architecture·overview"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>331 ········<a·href="architecture.html"·class="btn·btn-neutral·float-right"·title="Architecture·overview"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
332 ····</div>332 ····</div>
  
333 ··<hr/>333 ··<hr/>
  
334 ··<div·role="contentinfo">334 ··<div·role="contentinfo">
335 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.335 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
336 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.336 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
337 ······</span></p>337 ······</span></p>
338 ··</div>338 ··</div>
  
339 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a339 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
340 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>340 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
341 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.341 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
793 B
html2text {}
    
Offset 172, 9 lines modifiedOffset 172, 9 lines modified
172 native·Linux).172 native·Linux).
173 *\x8**\x8**\x8**\x8**\x8*·U\x8Us\x8si\x8in\x8ng\x8g·c\x8cu\x8us\x8st\x8to\x8om\x8m·a\x8as\x8sy\x8yn\x8nc\x8ci\x8io\x8o·l\x8lo\x8oo\x8op\x8ps\x8s_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*173 *\x8**\x8**\x8**\x8**\x8*·U\x8Us\x8si\x8in\x8ng\x8g·c\x8cu\x8us\x8st\x8to\x8om\x8m·a\x8as\x8sy\x8yn\x8nc\x8ci\x8io\x8o·l\x8lo\x8oo\x8op\x8ps\x8s_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*
174 You·can·also·use·custom·asyncio·event·loops·with·the·asyncio·reactor.·Set·the174 You·can·also·use·custom·asyncio·event·loops·with·the·asyncio·reactor.·Set·the
175 _\x8A_\x8S_\x8Y_\x8N_\x8C_\x8I_\x8O_\x8__\x8E_\x8V_\x8E_\x8N_\x8T_\x8__\x8L_\x8O_\x8O_\x8P·setting·to·the·import·path·of·the·desired·event·loop·class175 _\x8A_\x8S_\x8Y_\x8N_\x8C_\x8I_\x8O_\x8__\x8E_\x8V_\x8E_\x8N_\x8T_\x8__\x8L_\x8O_\x8O_\x8P·setting·to·the·import·path·of·the·desired·event·loop·class
176 to·use·it·instead·of·the·default·asyncio·event·loop.176 to·use·it·instead·of·the·default·asyncio·event·loop.
177 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t177 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
178 ===============================================================================178 ===============================================================================
179 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.179 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
180 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.180 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.65 KB
./usr/share/doc/python-scrapy-doc/html/topics/autothrottle.html
    
Offset 300, 15 lines modifiedOffset 300, 15 lines modified
300 ········<a·href="deploy.html"·class="btn·btn-neutral·float-left"·title="Deploying·Spiders"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>300 ········<a·href="deploy.html"·class="btn·btn-neutral·float-left"·title="Deploying·Spiders"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
301 ········<a·href="benchmarking.html"·class="btn·btn-neutral·float-right"·title="Benchmarking"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>301 ········<a·href="benchmarking.html"·class="btn·btn-neutral·float-right"·title="Benchmarking"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
302 ····</div>302 ····</div>
  
303 ··<hr/>303 ··<hr/>
  
304 ··<div·role="contentinfo">304 ··<div·role="contentinfo">
305 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.305 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
306 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.306 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
307 ······</span></p>307 ······</span></p>
308 ··</div>308 ··</div>
  
309 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a309 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
310 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>310 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
311 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.311 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
686 B
html2text {}
    
Offset 160, 9 lines modifiedOffset 160, 9 lines modified
160 *\x8**\x8**\x8**\x8*·A\x8AU\x8UT\x8TO\x8OT\x8TH\x8HR\x8RO\x8OT\x8TT\x8TL\x8LE\x8E_\x8_D\x8DE\x8EB\x8BU\x8UG\x8G_\x8?\x8·*\x8**\x8**\x8**\x8*160 *\x8**\x8**\x8**\x8*·A\x8AU\x8UT\x8TO\x8OT\x8TH\x8HR\x8RO\x8OT\x8TT\x8TL\x8LE\x8E_\x8_D\x8DE\x8EB\x8BU\x8UG\x8G_\x8?\x8·*\x8**\x8**\x8**\x8*
161 Default:·False161 Default:·False
162 Enable·AutoThrottle·debug·mode·which·will·display·stats·on·every·response162 Enable·AutoThrottle·debug·mode·which·will·display·stats·on·every·response
163 received,·so·you·can·see·how·the·throttling·parameters·are·being·adjusted·in163 received,·so·you·can·see·how·the·throttling·parameters·are·being·adjusted·in
164 real·time.164 real·time.
165 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t165 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
166 ===============================================================================166 ===============================================================================
167 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.167 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
168 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.168 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.75 KB
./usr/share/doc/python-scrapy-doc/html/topics/benchmarking.html
    
Offset 236, 15 lines modifiedOffset 236, 15 lines modified
236 ········<a·href="autothrottle.html"·class="btn·btn-neutral·float-left"·title="AutoThrottle·extension"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>236 ········<a·href="autothrottle.html"·class="btn·btn-neutral·float-left"·title="AutoThrottle·extension"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
237 ········<a·href="jobs.html"·class="btn·btn-neutral·float-right"·title="Jobs:·pausing·and·resuming·crawls"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>237 ········<a·href="jobs.html"·class="btn·btn-neutral·float-right"·title="Jobs:·pausing·and·resuming·crawls"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
238 ····</div>238 ····</div>
  
239 ··<hr/>239 ··<hr/>
  
240 ··<div·role="contentinfo">240 ··<div·role="contentinfo">
241 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.241 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
242 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.242 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
243 ······</span></p>243 ······</span></p>
244 ··</div>244 ··</div>
  
245 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a245 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
246 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>246 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
247 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.247 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
755 B
html2text {}
    
Offset 147, 9 lines modifiedOffset 147, 9 lines modified
147 hardware·where·you·run·it.·Note·that·this·is·a·very·simple·spider·intended·to147 hardware·where·you·run·it.·Note·that·this·is·a·very·simple·spider·intended·to
148 follow·links,·any·custom·spider·you·write·will·probably·do·more·stuff·which148 follow·links,·any·custom·spider·you·write·will·probably·do·more·stuff·which
149 results·in·slower·crawl·rates.·How·slower·depends·on·how·much·your·spider·does149 results·in·slower·crawl·rates.·How·slower·depends·on·how·much·your·spider·does
150 and·how·well·it’s·written.150 and·how·well·it’s·written.
151 Use·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8-_\x8b_\x8e_\x8n_\x8c_\x8h·for·more·complex·benchmarking.151 Use·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8-_\x8b_\x8e_\x8n_\x8c_\x8h·for·more·complex·benchmarking.
152 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t152 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
153 ===============================================================================153 ===============================================================================
154 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.154 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
155 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.155 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
2.0 KB
./usr/share/doc/python-scrapy-doc/html/topics/broad-crawls.html
    
Offset 354, 15 lines modifiedOffset 354, 15 lines modified
354 ········<a·href="practices.html"·class="btn·btn-neutral·float-left"·title="Common·Practices"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>354 ········<a·href="practices.html"·class="btn·btn-neutral·float-left"·title="Common·Practices"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
355 ········<a·href="developer-tools.html"·class="btn·btn-neutral·float-right"·title="Using·your·browser’s·Developer·Tools·for·scraping"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>355 ········<a·href="developer-tools.html"·class="btn·btn-neutral·float-right"·title="Using·your·browser’s·Developer·Tools·for·scraping"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
356 ····</div>356 ····</div>
  
357 ··<hr/>357 ··<hr/>
  
358 ··<div·role="contentinfo">358 ··<div·role="contentinfo">
359 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.359 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
360 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.360 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
361 ······</span></p>361 ······</span></p>
362 ··</div>362 ··</div>
  
363 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a363 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
364 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>364 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
365 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.365 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
1000 B
html2text {}
    
Offset 200, 9 lines modifiedOffset 200, 9 lines modified
200 If·your·broad·crawl·shows·a·high·memory·usage,·in·addition·to·_\x8c_\x8r_\x8a_\x8w_\x8l_\x8i_\x8n_\x8g_\x8·_\x8i_\x8n_\x8·_\x8B_\x8F_\x8O200 If·your·broad·crawl·shows·a·high·memory·usage,·in·addition·to·_\x8c_\x8r_\x8a_\x8w_\x8l_\x8i_\x8n_\x8g_\x8·_\x8i_\x8n_\x8·_\x8B_\x8F_\x8O
201 _\x8o_\x8r_\x8d_\x8e_\x8r·and·_\x8l_\x8o_\x8w_\x8e_\x8r_\x8i_\x8n_\x8g_\x8·_\x8c_\x8o_\x8n_\x8c_\x8u_\x8r_\x8r_\x8e_\x8n_\x8c_\x8y·you·should·_\x8d_\x8e_\x8b_\x8u_\x8g_\x8·_\x8y_\x8o_\x8u_\x8r_\x8·_\x8m_\x8e_\x8m_\x8o_\x8r_\x8y_\x8·_\x8l_\x8e_\x8a_\x8k_\x8s.201 _\x8o_\x8r_\x8d_\x8e_\x8r·and·_\x8l_\x8o_\x8w_\x8e_\x8r_\x8i_\x8n_\x8g_\x8·_\x8c_\x8o_\x8n_\x8c_\x8u_\x8r_\x8r_\x8e_\x8n_\x8c_\x8y·you·should·_\x8d_\x8e_\x8b_\x8u_\x8g_\x8·_\x8y_\x8o_\x8u_\x8r_\x8·_\x8m_\x8e_\x8m_\x8o_\x8r_\x8y_\x8·_\x8l_\x8e_\x8a_\x8k_\x8s.
202 *\x8**\x8**\x8**\x8**\x8*·I\x8In\x8ns\x8st\x8ta\x8al\x8ll\x8l·a\x8a·s\x8sp\x8pe\x8ec\x8ci\x8if\x8fi\x8ic\x8c·T\x8Tw\x8wi\x8is\x8st\x8te\x8ed\x8d·r\x8re\x8ea\x8ac\x8ct\x8to\x8or\x8r_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*202 *\x8**\x8**\x8**\x8**\x8*·I\x8In\x8ns\x8st\x8ta\x8al\x8ll\x8l·a\x8a·s\x8sp\x8pe\x8ec\x8ci\x8if\x8fi\x8ic\x8c·T\x8Tw\x8wi\x8is\x8st\x8te\x8ed\x8d·r\x8re\x8ea\x8ac\x8ct\x8to\x8or\x8r_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*
203 If·the·crawl·is·exceeding·the·system’s·capabilities,·you·might·want·to·try203 If·the·crawl·is·exceeding·the·system’s·capabilities,·you·might·want·to·try
204 installing·a·specific·Twisted·reactor,·via·the·_\x8T_\x8W_\x8I_\x8S_\x8T_\x8E_\x8D_\x8__\x8R_\x8E_\x8A_\x8C_\x8T_\x8O_\x8R·setting.204 installing·a·specific·Twisted·reactor,·via·the·_\x8T_\x8W_\x8I_\x8S_\x8T_\x8E_\x8D_\x8__\x8R_\x8E_\x8A_\x8C_\x8T_\x8O_\x8R·setting.
205 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t205 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
206 ===============================================================================206 ===============================================================================
207 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.207 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
208 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.208 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.49 KB
./usr/share/doc/python-scrapy-doc/html/topics/commands.html
    
Offset 725, 15 lines modifiedOffset 725, 15 lines modified
725 ········<a·href="../intro/examples.html"·class="btn·btn-neutral·float-left"·title="Examples"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>725 ········<a·href="../intro/examples.html"·class="btn·btn-neutral·float-left"·title="Examples"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
726 ········<a·href="spiders.html"·class="btn·btn-neutral·float-right"·title="Spiders"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>726 ········<a·href="spiders.html"·class="btn·btn-neutral·float-right"·title="Spiders"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
727 ····</div>727 ····</div>
  
728 ··<hr/>728 ··<hr/>
  
729 ··<div·role="contentinfo">729 ··<div·role="contentinfo">
730 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.730 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
731 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.731 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
732 ······</span></p>732 ······</span></p>
733 ··</div>733 ··</div>
  
734 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a734 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
735 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>735 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
736 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.736 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
534 B
html2text {}
    
Offset 487, 9 lines modifiedOffset 487, 9 lines modified
487 ········"scrapy.commands":·[487 ········"scrapy.commands":·[
488 ············"my_command=my_scrapy_module.commands:MyCommand",488 ············"my_command=my_scrapy_module.commands:MyCommand",
489 ········],489 ········],
490 ····},490 ····},
491 )491 )
492 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t492 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
493 ===============================================================================493 ===============================================================================
494 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.494 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
495 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.495 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.63 KB
./usr/share/doc/python-scrapy-doc/html/topics/components.html
    
Offset 220, 15 lines modifiedOffset 220, 15 lines modified
220 ········<a·href="exporters.html"·class="btn·btn-neutral·float-left"·title="Item·Exporters"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>220 ········<a·href="exporters.html"·class="btn·btn-neutral·float-left"·title="Item·Exporters"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
221 ········<a·href="api.html"·class="btn·btn-neutral·float-right"·title="Core·API"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>221 ········<a·href="api.html"·class="btn·btn-neutral·float-right"·title="Core·API"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
222 ····</div>222 ····</div>
  
223 ··<hr/>223 ··<hr/>
  
224 ··<div·role="contentinfo">224 ··<div·role="contentinfo">
225 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.225 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
226 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.226 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
227 ······</span></p>227 ······</span></p>
228 ··</div>228 ··</div>
  
229 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a229 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
230 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>230 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
231 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.231 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
679 B
html2text {}
    
Offset 108, 9 lines modifiedOffset 108, 9 lines modified
108 ················f"{MyComponent.__qualname__}·requires·Scrapy·2.7·or·"108 ················f"{MyComponent.__qualname__}·requires·Scrapy·2.7·or·"
109 ················f"later,·which·allow·defining·the·process_spider_output·"109 ················f"later,·which·allow·defining·the·process_spider_output·"
110 ················f"method·of·spider·middlewares·as·an·asynchronous·"110 ················f"method·of·spider·middlewares·as·an·asynchronous·"
111 ················f"generator."111 ················f"generator."
112 ············)112 ············)
113 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t113 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
114 ===============================================================================114 ===============================================================================
115 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.115 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
116 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.116 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.55 KB
./usr/share/doc/python-scrapy-doc/html/topics/contracts.html
    
Offset 338, 15 lines modifiedOffset 338, 15 lines modified
338 ········<a·href="debug.html"·class="btn·btn-neutral·float-left"·title="Debugging·Spiders"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>338 ········<a·href="debug.html"·class="btn·btn-neutral·float-left"·title="Debugging·Spiders"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
339 ········<a·href="practices.html"·class="btn·btn-neutral·float-right"·title="Common·Practices"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>339 ········<a·href="practices.html"·class="btn·btn-neutral·float-right"·title="Common·Practices"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
340 ····</div>340 ····</div>
  
341 ··<hr/>341 ··<hr/>
  
342 ··<div·role="contentinfo">342 ··<div·role="contentinfo">
343 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.343 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
344 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.344 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
345 ······</span></p>345 ······</span></p>
346 ··</div>346 ··</div>
  
347 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a347 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
348 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>348 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
349 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.349 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
584 B
html2text {}
    
Offset 168, 9 lines modifiedOffset 168, 9 lines modified
168 ····name·=·"example"168 ····name·=·"example"
  
169 ····def·__init__(self):169 ····def·__init__(self):
170 ········if·os.environ.get("SCRAPY_CHECK"):170 ········if·os.environ.get("SCRAPY_CHECK"):
171 ············pass··#·Do·some·scraper·adjustments·when·a·check·is·running171 ············pass··#·Do·some·scraper·adjustments·when·a·check·is·running
172 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t172 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
173 ===============================================================================173 ===============================================================================
174 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.174 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
175 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.175 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.71 KB
./usr/share/doc/python-scrapy-doc/html/topics/coroutines.html
    
Offset 419, 15 lines modifiedOffset 419, 15 lines modified
419 ········<a·href="jobs.html"·class="btn·btn-neutral·float-left"·title="Jobs:·pausing·and·resuming·crawls"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>419 ········<a·href="jobs.html"·class="btn·btn-neutral·float-left"·title="Jobs:·pausing·and·resuming·crawls"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
420 ········<a·href="asyncio.html"·class="btn·btn-neutral·float-right"·title="asyncio"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>420 ········<a·href="asyncio.html"·class="btn·btn-neutral·float-right"·title="asyncio"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
421 ····</div>421 ····</div>
  
422 ··<hr/>422 ··<hr/>
  
423 ··<div·role="contentinfo">423 ··<div·role="contentinfo">
424 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.424 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
425 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.425 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
426 ······</span></p>426 ······</span></p>
427 ··</div>427 ··</div>
  
428 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a428 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
429 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>429 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
430 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.430 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
740 B
html2text {}
    
Offset 250, 9 lines modifiedOffset 250, 9 lines modified
250 and·works·in·earlier·Scrapy·versions·as·well.250 and·works·in·earlier·Scrapy·versions·as·well.
251 In·some·future·version·of·Scrapy,·however,·this·feature·will·be·deprecated·and,251 In·some·future·version·of·Scrapy,·however,·this·feature·will·be·deprecated·and,
252 eventually,·in·a·later·version·of·Scrapy,·this·feature·will·be·removed,·and·all252 eventually,·in·a·later·version·of·Scrapy,·this·feature·will·be·removed,·and·all
253 spider·middlewares·will·be·expected·to·define·their·process_spider_output253 spider·middlewares·will·be·expected·to·define·their·process_spider_output
254 method·as·an·asynchronous·generator.254 method·as·an·asynchronous·generator.
255 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t255 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
256 ===============================================================================256 ===============================================================================
257 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.257 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
258 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.258 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.51 KB
./usr/share/doc/python-scrapy-doc/html/topics/debug.html
    
Offset 332, 15 lines modifiedOffset 332, 15 lines modified
332 ········<a·href="../faq.html"·class="btn·btn-neutral·float-left"·title="Frequently·Asked·Questions"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>332 ········<a·href="../faq.html"·class="btn·btn-neutral·float-left"·title="Frequently·Asked·Questions"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
333 ········<a·href="contracts.html"·class="btn·btn-neutral·float-right"·title="Spiders·Contracts"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>333 ········<a·href="contracts.html"·class="btn·btn-neutral·float-right"·title="Spiders·Contracts"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
334 ····</div>334 ····</div>
  
335 ··<hr/>335 ··<hr/>
  
336 ··<div·role="contentinfo">336 ··<div·role="contentinfo">
337 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.337 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
338 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.338 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
339 ······</span></p>339 ······</span></p>
340 ··</div>340 ··</div>
  
341 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a341 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
342 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>342 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
343 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.343 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
539 B
html2text {}
    
Offset 198, 9 lines modifiedOffset 198, 9 lines modified
198 ········}198 ········}
199 ····]199 ····]
200 }200 }
201 Also,·make·sure·you·enable·“User·Uncaught·Exceptions”,·to·catch·exceptions·in201 Also,·make·sure·you·enable·“User·Uncaught·Exceptions”,·to·catch·exceptions·in
202 your·Scrapy·spider.202 your·Scrapy·spider.
203 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t203 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
204 ===============================================================================204 ===============================================================================
205 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.205 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
206 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.206 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.81 KB
./usr/share/doc/python-scrapy-doc/html/topics/deploy.html
    
Offset 197, 15 lines modifiedOffset 197, 15 lines modified
197 ········<a·href="media-pipeline.html"·class="btn·btn-neutral·float-left"·title="Downloading·and·processing·files·and·images"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>197 ········<a·href="media-pipeline.html"·class="btn·btn-neutral·float-left"·title="Downloading·and·processing·files·and·images"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
198 ········<a·href="autothrottle.html"·class="btn·btn-neutral·float-right"·title="AutoThrottle·extension"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>198 ········<a·href="autothrottle.html"·class="btn·btn-neutral·float-right"·title="AutoThrottle·extension"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
199 ····</div>199 ····</div>
  
200 ··<hr/>200 ··<hr/>
  
201 ··<div·role="contentinfo">201 ··<div·role="contentinfo">
202 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.202 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
203 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.203 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
204 ······</span></p>204 ······</span></p>
205 ··</div>205 ··</div>
  
206 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a206 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
207 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>207 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
208 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.208 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
811 B
html2text {}
    
Offset 86, 9 lines modifiedOffset 86, 9 lines modified
86 To·deploy·spiders·to·Zyte·Scrapy·Cloud·you·can·use·the·_\x8s_\x8h_\x8u_\x8b·command·line·tool.86 To·deploy·spiders·to·Zyte·Scrapy·Cloud·you·can·use·the·_\x8s_\x8h_\x8u_\x8b·command·line·tool.
87 Please·refer·to·the·_\x8Z_\x8y_\x8t_\x8e_\x8·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y_\x8·_\x8C_\x8l_\x8o_\x8u_\x8d_\x8·_\x8d_\x8o_\x8c_\x8u_\x8m_\x8e_\x8n_\x8t_\x8a_\x8t_\x8i_\x8o_\x8n·for·more·information.87 Please·refer·to·the·_\x8Z_\x8y_\x8t_\x8e_\x8·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y_\x8·_\x8C_\x8l_\x8o_\x8u_\x8d_\x8·_\x8d_\x8o_\x8c_\x8u_\x8m_\x8e_\x8n_\x8t_\x8a_\x8t_\x8i_\x8o_\x8n·for·more·information.
88 Zyte·Scrapy·Cloud·is·compatible·with·Scrapyd·and·one·can·switch·between·them·as88 Zyte·Scrapy·Cloud·is·compatible·with·Scrapyd·and·one·can·switch·between·them·as
89 needed·-·the·configuration·is·read·from·the·scrapy.cfg·file·just·like·scrapyd-89 needed·-·the·configuration·is·read·from·the·scrapy.cfg·file·just·like·scrapyd-
90 deploy.90 deploy.
91 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t91 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
92 ===============================================================================92 ===============================================================================
93 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.93 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
94 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.94 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.75 KB
./usr/share/doc/python-scrapy-doc/html/topics/developer-tools.html
    
Offset 419, 15 lines modifiedOffset 419, 15 lines modified
419 ········<a·href="broad-crawls.html"·class="btn·btn-neutral·float-left"·title="Broad·Crawls"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>419 ········<a·href="broad-crawls.html"·class="btn·btn-neutral·float-left"·title="Broad·Crawls"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
420 ········<a·href="dynamic-content.html"·class="btn·btn-neutral·float-right"·title="Selecting·dynamically-loaded·content"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>420 ········<a·href="dynamic-content.html"·class="btn·btn-neutral·float-right"·title="Selecting·dynamically-loaded·content"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
421 ····</div>421 ····</div>
  
422 ··<hr/>422 ··<hr/>
  
423 ··<div·role="contentinfo">423 ··<div·role="contentinfo">
424 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.424 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
425 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.425 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
426 ······</span></p>426 ······</span></p>
427 ··</div>427 ··</div>
  
428 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a428 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
429 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>429 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
430 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.430 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
752 B
html2text {}
    
Offset 277, 9 lines modifiedOffset 277, 9 lines modified
277 As·you·can·see,·with·a·few·inspections·in·theNetwork-tool·we·were·able·to277 As·you·can·see,·with·a·few·inspections·in·theNetwork-tool·we·were·able·to
278 easily·replicate·the·dynamic·requests·of·the·scrolling·functionality·of·the278 easily·replicate·the·dynamic·requests·of·the·scrolling·functionality·of·the
279 page.·Crawling·dynamic·pages·can·be·quite·daunting·and·pages·can·be·very279 page.·Crawling·dynamic·pages·can·be·quite·daunting·and·pages·can·be·very
280 complex,·but·it·(mostly)·boils·down·to·identifying·the·correct·request·and280 complex,·but·it·(mostly)·boils·down·to·identifying·the·correct·request·and
281 replicating·it·in·your·spider.281 replicating·it·in·your·spider.
282 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t282 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
283 ===============================================================================283 ===============================================================================
284 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.284 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
285 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.285 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.44 KB
./usr/share/doc/python-scrapy-doc/html/topics/djangoitem.html
    
Offset 160, 15 lines modifiedOffset 160, 15 lines modified
160 ···········</div>160 ···········</div>
161 ··········</div>161 ··········</div>
162 ··········<footer>162 ··········<footer>
  
163 ··<hr/>163 ··<hr/>
  
164 ··<div·role="contentinfo">164 ··<div·role="contentinfo">
165 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.165 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
166 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.166 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
167 ······</span></p>167 ······</span></p>
168 ··</div>168 ··</div>
  
169 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a169 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
170 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>170 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
171 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.171 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
819 B
html2text {}
    
Offset 60, 9 lines modifiedOffset 60, 9 lines modified
60 ····*·_\x8V_\x8i_\x8e_\x8w_\x8·_\x8p_\x8a_\x8g_\x8e_\x8·_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e60 ····*·_\x8V_\x8i_\x8e_\x8w_\x8·_\x8p_\x8a_\x8g_\x8e_\x8·_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e
61 ===============================================================================61 ===============================================================================
62 *\x8**\x8**\x8**\x8**\x8**\x8*·D\x8Dj\x8ja\x8an\x8ng\x8go\x8oI\x8It\x8te\x8em\x8m_\x8?\x8·*\x8**\x8**\x8**\x8**\x8**\x8*62 *\x8**\x8**\x8**\x8**\x8**\x8*·D\x8Dj\x8ja\x8an\x8ng\x8go\x8oI\x8It\x8te\x8em\x8m_\x8?\x8·*\x8**\x8**\x8**\x8**\x8**\x8*
63 DjangoItem·has·been·moved·into·a·separate·project.63 DjangoItem·has·been·moved·into·a·separate·project.
64 It·is·hosted·at:64 It·is·hosted·at:
65 ·····_\x8h_\x8t_\x8t_\x8p_\x8s_\x8:_\x8/_\x8/_\x8g_\x8i_\x8t_\x8h_\x8u_\x8b_\x8._\x8c_\x8o_\x8m_\x8/_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8-_\x8p_\x8l_\x8u_\x8g_\x8i_\x8n_\x8s_\x8/_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8-_\x8d_\x8j_\x8a_\x8n_\x8g_\x8o_\x8i_\x8t_\x8e_\x8m65 ·····_\x8h_\x8t_\x8t_\x8p_\x8s_\x8:_\x8/_\x8/_\x8g_\x8i_\x8t_\x8h_\x8u_\x8b_\x8._\x8c_\x8o_\x8m_\x8/_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8-_\x8p_\x8l_\x8u_\x8g_\x8i_\x8n_\x8s_\x8/_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8-_\x8d_\x8j_\x8a_\x8n_\x8g_\x8o_\x8i_\x8t_\x8e_\x8m
66 ===============================================================================66 ===============================================================================
67 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.67 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
68 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.68 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.65 KB
./usr/share/doc/python-scrapy-doc/html/topics/downloader-middleware.html
    
Offset 1320, 15 lines modifiedOffset 1320, 15 lines modified
1320 ········<a·href="addons.html"·class="btn·btn-neutral·float-left"·title="Add-ons"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>1320 ········<a·href="addons.html"·class="btn·btn-neutral·float-left"·title="Add-ons"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
1321 ········<a·href="spider-middleware.html"·class="btn·btn-neutral·float-right"·title="Spider·Middleware"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>1321 ········<a·href="spider-middleware.html"·class="btn·btn-neutral·float-right"·title="Spider·Middleware"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
1322 ····</div>1322 ····</div>
  
1323 ··<hr/>1323 ··<hr/>
  
1324 ··<div·role="contentinfo">1324 ··<div·role="contentinfo">
1325 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.1325 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
1326 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.1326 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
1327 ······</span></p>1327 ······</span></p>
1328 ··</div>1328 ··</div>
  
1329 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a1329 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
1330 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>1330 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
1331 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.1331 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
665 B
html2text {}
    
Offset 819, 9 lines modifiedOffset 819, 9 lines modified
819 Default:·True819 Default:·True
820 Whether·or·not·to·enable·the·HttpProxyMiddleware.820 Whether·or·not·to·enable·the·HttpProxyMiddleware.
821 *\x8**\x8*·H\x8HT\x8TT\x8TP\x8PP\x8PR\x8RO\x8OX\x8XY\x8Y_\x8_A\x8AU\x8UT\x8TH\x8H_\x8_E\x8EN\x8NC\x8CO\x8OD\x8DI\x8IN\x8NG\x8G_\x8?\x8·*\x8**\x8*821 *\x8**\x8*·H\x8HT\x8TT\x8TP\x8PP\x8PR\x8RO\x8OX\x8XY\x8Y_\x8_A\x8AU\x8UT\x8TH\x8H_\x8_E\x8EN\x8NC\x8CO\x8OD\x8DI\x8IN\x8NG\x8G_\x8?\x8·*\x8**\x8*
822 Default:·"latin-1"822 Default:·"latin-1"
823 The·default·encoding·for·proxy·authentication·on·HttpProxyMiddleware.823 The·default·encoding·for·proxy·authentication·on·HttpProxyMiddleware.
824 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t824 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
825 ===============================================================================825 ===============================================================================
826 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.826 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
827 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.827 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.78 KB
./usr/share/doc/python-scrapy-doc/html/topics/dynamic-content.html
    
Offset 385, 15 lines modifiedOffset 385, 15 lines modified
385 ········<a·href="developer-tools.html"·class="btn·btn-neutral·float-left"·title="Using·your·browser’s·Developer·Tools·for·scraping"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>385 ········<a·href="developer-tools.html"·class="btn·btn-neutral·float-left"·title="Using·your·browser’s·Developer·Tools·for·scraping"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
386 ········<a·href="leaks.html"·class="btn·btn-neutral·float-right"·title="Debugging·memory·leaks"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>386 ········<a·href="leaks.html"·class="btn·btn-neutral·float-right"·title="Debugging·memory·leaks"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
387 ····</div>387 ····</div>
  
388 ··<hr/>388 ··<hr/>
  
389 ··<div·role="contentinfo">389 ··<div·role="contentinfo">
390 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.390 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
391 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.391 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
392 ······</span></p>392 ······</span></p>
393 ··</div>393 ··</div>
  
394 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a394 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
395 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>395 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
396 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.396 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
769 B
html2text {}
    
Offset 227, 9 lines modifiedOffset 227, 9 lines modified
227 ············title·=·await·page.title()227 ············title·=·await·page.title()
228 ············return·{"title":·title}228 ············return·{"title":·title}
229 However,·using·_\x8p_\x8l_\x8a_\x8y_\x8w_\x8r_\x8i_\x8g_\x8h_\x8t_\x8-_\x8p_\x8y_\x8t_\x8h_\x8o_\x8n·directly·as·in·the·above·example·circumvents229 However,·using·_\x8p_\x8l_\x8a_\x8y_\x8w_\x8r_\x8i_\x8g_\x8h_\x8t_\x8-_\x8p_\x8y_\x8t_\x8h_\x8o_\x8n·directly·as·in·the·above·example·circumvents
230 most·of·the·Scrapy·components·(middlewares,·dupefilter,·etc).·We·recommend230 most·of·the·Scrapy·components·(middlewares,·dupefilter,·etc).·We·recommend
231 using·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8-_\x8p_\x8l_\x8a_\x8y_\x8w_\x8r_\x8i_\x8g_\x8h_\x8t·for·a·better·integration.231 using·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8-_\x8p_\x8l_\x8a_\x8y_\x8w_\x8r_\x8i_\x8g_\x8h_\x8t·for·a·better·integration.
232 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t232 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
233 ===============================================================================233 ===============================================================================
234 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.234 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
235 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.235 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.64 KB
./usr/share/doc/python-scrapy-doc/html/topics/email.html
    
Offset 315, 15 lines modifiedOffset 315, 15 lines modified
315 ········<a·href="stats.html"·class="btn·btn-neutral·float-left"·title="Stats·Collection"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>315 ········<a·href="stats.html"·class="btn·btn-neutral·float-left"·title="Stats·Collection"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
316 ········<a·href="telnetconsole.html"·class="btn·btn-neutral·float-right"·title="Telnet·Console"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>316 ········<a·href="telnetconsole.html"·class="btn·btn-neutral·float-right"·title="Telnet·Console"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
317 ····</div>317 ····</div>
  
318 ··<hr/>318 ··<hr/>
  
319 ··<div·role="contentinfo">319 ··<div·role="contentinfo">
320 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.320 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
321 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.321 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
322 ······</span></p>322 ······</span></p>
323 ··</div>323 ··</div>
  
324 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a324 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
325 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>325 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
326 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.326 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
683 B
html2text {}
    
Offset 162, 9 lines modifiedOffset 162, 9 lines modified
162 Enforce·using·STARTTLS.·STARTTLS·is·a·way·to·take·an·existing·insecure162 Enforce·using·STARTTLS.·STARTTLS·is·a·way·to·take·an·existing·insecure
163 connection,·and·upgrade·it·to·a·secure·connection·using·SSL/TLS.163 connection,·and·upgrade·it·to·a·secure·connection·using·SSL/TLS.
164 *\x8**\x8**\x8**\x8*·M\x8MA\x8AI\x8IL\x8L_\x8_S\x8SS\x8SL\x8L_\x8?\x8·*\x8**\x8**\x8**\x8*164 *\x8**\x8**\x8**\x8*·M\x8MA\x8AI\x8IL\x8L_\x8_S\x8SS\x8SL\x8L_\x8?\x8·*\x8**\x8**\x8**\x8*
165 Default:·False165 Default:·False
166 Enforce·connecting·using·an·SSL·encrypted·connection166 Enforce·connecting·using·an·SSL·encrypted·connection
167 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t167 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
168 ===============================================================================168 ===============================================================================
169 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.169 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
170 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.170 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.79 KB
./usr/share/doc/python-scrapy-doc/html/topics/exceptions.html
    
Offset 312, 15 lines modifiedOffset 312, 15 lines modified
312 ········<a·href="settings.html"·class="btn·btn-neutral·float-left"·title="Settings"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>312 ········<a·href="settings.html"·class="btn·btn-neutral·float-left"·title="Settings"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
313 ········<a·href="logging.html"·class="btn·btn-neutral·float-right"·title="Logging"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>313 ········<a·href="logging.html"·class="btn·btn-neutral·float-right"·title="Logging"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
314 ····</div>314 ····</div>
  
315 ··<hr/>315 ··<hr/>
  
316 ··<div·role="contentinfo">316 ··<div·role="contentinfo">
317 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.317 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
318 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.318 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
319 ······</span></p>319 ······</span></p>
320 ··</div>320 ··</div>
  
321 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a321 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
322 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>322 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
323 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.323 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
849 B
html2text {}
    
Offset 133, 9 lines modifiedOffset 133, 9 lines modified
133 fail·is·a·keyword-only·parameter,·i.e.·raising·StopDownload(False)·or133 fail·is·a·keyword-only·parameter,·i.e.·raising·StopDownload(False)·or
134 StopDownload(True)·will·raise·a·_\x8T_\x8y_\x8p_\x8e_\x8E_\x8r_\x8r_\x8o_\x8r.134 StopDownload(True)·will·raise·a·_\x8T_\x8y_\x8p_\x8e_\x8E_\x8r_\x8r_\x8o_\x8r.
135 See·the·documentation·for·the·_\x8b_\x8y_\x8t_\x8e_\x8s_\x8__\x8r_\x8e_\x8c_\x8e_\x8i_\x8v_\x8e_\x8d·and·_\x8h_\x8e_\x8a_\x8d_\x8e_\x8r_\x8s_\x8__\x8r_\x8e_\x8c_\x8e_\x8i_\x8v_\x8e_\x8d·signals·and135 See·the·documentation·for·the·_\x8b_\x8y_\x8t_\x8e_\x8s_\x8__\x8r_\x8e_\x8c_\x8e_\x8i_\x8v_\x8e_\x8d·and·_\x8h_\x8e_\x8a_\x8d_\x8e_\x8r_\x8s_\x8__\x8r_\x8e_\x8c_\x8e_\x8i_\x8v_\x8e_\x8d·signals·and
136 the·_\x8S_\x8t_\x8o_\x8p_\x8p_\x8i_\x8n_\x8g_\x8·_\x8t_\x8h_\x8e_\x8·_\x8d_\x8o_\x8w_\x8n_\x8l_\x8o_\x8a_\x8d_\x8·_\x8o_\x8f_\x8·_\x8a_\x8·_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e·topic·for·additional·information·and136 the·_\x8S_\x8t_\x8o_\x8p_\x8p_\x8i_\x8n_\x8g_\x8·_\x8t_\x8h_\x8e_\x8·_\x8d_\x8o_\x8w_\x8n_\x8l_\x8o_\x8a_\x8d_\x8·_\x8o_\x8f_\x8·_\x8a_\x8·_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e·topic·for·additional·information·and
137 examples.137 examples.
138 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t138 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
139 ===============================================================================139 ===============================================================================
140 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.140 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
141 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.141 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.7 KB
./usr/share/doc/python-scrapy-doc/html/topics/exporters.html
    
Offset 670, 15 lines modifiedOffset 670, 15 lines modified
670 ········<a·href="scheduler.html"·class="btn·btn-neutral·float-left"·title="Scheduler"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>670 ········<a·href="scheduler.html"·class="btn·btn-neutral·float-left"·title="Scheduler"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
671 ········<a·href="components.html"·class="btn·btn-neutral·float-right"·title="Components"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>671 ········<a·href="components.html"·class="btn·btn-neutral·float-right"·title="Components"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
672 ····</div>672 ····</div>
  
673 ··<hr/>673 ··<hr/>
  
674 ··<div·role="contentinfo">674 ··<div·role="contentinfo">
675 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.675 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
676 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.676 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
677 ······</span></p>677 ······</span></p>
678 ··</div>678 ··</div>
  
679 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a679 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
680 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>680 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
681 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.681 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
750 B
html2text {}
    
Offset 390, 9 lines modifiedOffset 390, 9 lines modified
390 ······Exports·items·in·a·Python-specific·binary·format·(see·_\x8m_\x8a_\x8r_\x8s_\x8h_\x8a_\x8l).390 ······Exports·items·in·a·Python-specific·binary·format·(see·_\x8m_\x8a_\x8r_\x8s_\x8h_\x8a_\x8l).
391 ········Parameters:391 ········Parameters:
392 ············f\x8fi\x8il\x8le\x8e·–·The·file-like·object·to·use·for·exporting·the·data.·Its392 ············f\x8fi\x8il\x8le\x8e·–·The·file-like·object·to·use·for·exporting·the·data.·Its
393 ············write·method·should·accept·_\x8b_\x8y_\x8t_\x8e_\x8s·(a·disk·file·opened·in·binary393 ············write·method·should·accept·_\x8b_\x8y_\x8t_\x8e_\x8s·(a·disk·file·opened·in·binary
394 ············mode,·a·_\x8B_\x8y_\x8t_\x8e_\x8s_\x8I_\x8O·object,·etc)394 ············mode,·a·_\x8B_\x8y_\x8t_\x8e_\x8s_\x8I_\x8O·object,·etc)
395 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t395 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
396 ===============================================================================396 ===============================================================================
397 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.397 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
398 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.398 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.75 KB
./usr/share/doc/python-scrapy-doc/html/topics/extensions.html
    
Offset 622, 15 lines modifiedOffset 622, 15 lines modified
622 ········<a·href="spider-middleware.html"·class="btn·btn-neutral·float-left"·title="Spider·Middleware"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>622 ········<a·href="spider-middleware.html"·class="btn·btn-neutral·float-left"·title="Spider·Middleware"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
623 ········<a·href="signals.html"·class="btn·btn-neutral·float-right"·title="Signals"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>623 ········<a·href="signals.html"·class="btn·btn-neutral·float-right"·title="Signals"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
624 ····</div>624 ····</div>
  
625 ··<hr/>625 ··<hr/>
  
626 ··<div·role="contentinfo">626 ··<div·role="contentinfo">
627 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.627 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
628 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.628 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
629 ······</span></p>629 ······</span></p>
630 ··</div>630 ··</div>
  
631 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a631 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
632 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>632 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
633 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.633 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
789 B
html2text {}
    
Offset 378, 9 lines modifiedOffset 378, 9 lines modified
378 Invokes·a·_\x8P_\x8y_\x8t_\x8h_\x8o_\x8n_\x8·_\x8d_\x8e_\x8b_\x8u_\x8g_\x8g_\x8e_\x8r·inside·a·running·Scrapy·process·when·a·_\x8S_\x8I_\x8G_\x8U_\x8S_\x8R_\x82·signal378 Invokes·a·_\x8P_\x8y_\x8t_\x8h_\x8o_\x8n_\x8·_\x8d_\x8e_\x8b_\x8u_\x8g_\x8g_\x8e_\x8r·inside·a·running·Scrapy·process·when·a·_\x8S_\x8I_\x8G_\x8U_\x8S_\x8R_\x82·signal
379 is·received.·After·the·debugger·is·exited,·the·Scrapy·process·continues·running379 is·received.·After·the·debugger·is·exited,·the·Scrapy·process·continues·running
380 normally.380 normally.
381 For·more·info·see·_\x8D_\x8e_\x8b_\x8u_\x8g_\x8g_\x8i_\x8n_\x8g_\x8·_\x8i_\x8n_\x8·_\x8P_\x8y_\x8t_\x8h_\x8o_\x8n.381 For·more·info·see·_\x8D_\x8e_\x8b_\x8u_\x8g_\x8g_\x8i_\x8n_\x8g_\x8·_\x8i_\x8n_\x8·_\x8P_\x8y_\x8t_\x8h_\x8o_\x8n.
382 This·extension·only·works·on·POSIX-compliant·platforms·(i.e.·not·Windows).382 This·extension·only·works·on·POSIX-compliant·platforms·(i.e.·not·Windows).
383 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t383 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
384 ===============================================================================384 ===============================================================================
385 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.385 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
386 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.386 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.69 KB
./usr/share/doc/python-scrapy-doc/html/topics/feed-exports.html
    
Offset 951, 15 lines modifiedOffset 951, 15 lines modified
951 ········<a·href="item-pipeline.html"·class="btn·btn-neutral·float-left"·title="Item·Pipeline"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>951 ········<a·href="item-pipeline.html"·class="btn·btn-neutral·float-left"·title="Item·Pipeline"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
952 ········<a·href="request-response.html"·class="btn·btn-neutral·float-right"·title="Requests·and·Responses"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>952 ········<a·href="request-response.html"·class="btn·btn-neutral·float-right"·title="Requests·and·Responses"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
953 ····</div>953 ····</div>
  
954 ··<hr/>954 ··<hr/>
  
955 ··<div·role="contentinfo">955 ··<div·role="contentinfo">
956 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.956 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
957 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.957 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
958 ······</span></p>958 ······</span></p>
959 ··</div>959 ··</div>
  
960 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a960 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
961 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>961 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
962 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.962 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
703 B
html2text {}
    
Offset 557, 9 lines modifiedOffset 557, 9 lines modified
557 ···2.·Point·_\x8F_\x8E_\x8E_\x8D_\x8__\x8U_\x8R_\x8I_\x8__\x8P_\x8A_\x8R_\x8A_\x8M_\x8S·to·that·function·in·your·settings:557 ···2.·Point·_\x8F_\x8E_\x8E_\x8D_\x8__\x8U_\x8R_\x8I_\x8__\x8P_\x8A_\x8R_\x8A_\x8M_\x8S·to·that·function·in·your·settings:
558 ······#·myproject/settings.py558 ······#·myproject/settings.py
559 ······FEED_URI_PARAMS·=·"myproject.utils.uri_params"559 ······FEED_URI_PARAMS·=·"myproject.utils.uri_params"
560 ···3.·Use·%(spider_name)s·in·your·feed·URI:560 ···3.·Use·%(spider_name)s·in·your·feed·URI:
561 ······scrapy·crawl·<spider_name>·-o·"%(spider_name)s.jsonl"561 ······scrapy·crawl·<spider_name>·-o·"%(spider_name)s.jsonl"
562 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t562 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
563 ===============================================================================563 ===============================================================================
564 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.564 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
565 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.565 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.66 KB
./usr/share/doc/python-scrapy-doc/html/topics/item-pipeline.html
    
Offset 434, 15 lines modifiedOffset 434, 15 lines modified
434 ········<a·href="shell.html"·class="btn·btn-neutral·float-left"·title="Scrapy·shell"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>434 ········<a·href="shell.html"·class="btn·btn-neutral·float-left"·title="Scrapy·shell"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
435 ········<a·href="feed-exports.html"·class="btn·btn-neutral·float-right"·title="Feed·exports"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>435 ········<a·href="feed-exports.html"·class="btn·btn-neutral·float-right"·title="Feed·exports"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
436 ····</div>436 ····</div>
  
437 ··<hr/>437 ··<hr/>
  
438 ··<div·role="contentinfo">438 ··<div·role="contentinfo">
439 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.439 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
440 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.440 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
441 ······</span></p>441 ······</span></p>
442 ··</div>442 ··</div>
  
443 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a443 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
444 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>444 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
445 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.445 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
693 B
html2text {}
    
Offset 262, 9 lines modifiedOffset 262, 9 lines modified
262 ····"myproject.pipelines.JsonWriterPipeline":·800,262 ····"myproject.pipelines.JsonWriterPipeline":·800,
263 }263 }
264 The·integer·values·you·assign·to·classes·in·this·setting·determine·the·order·in264 The·integer·values·you·assign·to·classes·in·this·setting·determine·the·order·in
265 which·they·run:·items·go·through·from·lower·valued·to·higher·valued·classes.265 which·they·run:·items·go·through·from·lower·valued·to·higher·valued·classes.
266 It’s·customary·to·define·these·numbers·in·the·0-1000·range.266 It’s·customary·to·define·these·numbers·in·the·0-1000·range.
267 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t267 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
268 ===============================================================================268 ===============================================================================
269 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.269 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
270 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.270 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.75 KB
./usr/share/doc/python-scrapy-doc/html/topics/items.html
    
Offset 562, 15 lines modifiedOffset 562, 15 lines modified
562 ········<a·href="selectors.html"·class="btn·btn-neutral·float-left"·title="Selectors"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>562 ········<a·href="selectors.html"·class="btn·btn-neutral·float-left"·title="Selectors"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
563 ········<a·href="loaders.html"·class="btn·btn-neutral·float-right"·title="Item·Loaders"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>563 ········<a·href="loaders.html"·class="btn·btn-neutral·float-right"·title="Item·Loaders"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
564 ····</div>564 ····</div>
  
565 ··<hr/>565 ··<hr/>
  
566 ··<div·role="contentinfo">566 ··<div·role="contentinfo">
567 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.567 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
568 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.568 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
569 ······</span></p>569 ······</span></p>
570 ··</div>570 ··</div>
  
571 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a571 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
572 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>572 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
573 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.573 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
808 B
html2text {}
    
Offset 325, 9 lines modifiedOffset 325, 9 lines modified
325 ······False·otherwise.325 ······False·otherwise.
326 ······Alias·for·ItemAdapter.is_item326 ······Alias·for·ItemAdapter.is_item
327 *\x8**\x8**\x8**\x8**\x8*·O\x8Ot\x8th\x8he\x8er\x8r·c\x8cl\x8la\x8as\x8ss\x8se\x8es\x8s·r\x8re\x8el\x8la\x8at\x8te\x8ed\x8d·t\x8to\x8o·i\x8it\x8te\x8em\x8ms\x8s_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*327 *\x8**\x8**\x8**\x8**\x8*·O\x8Ot\x8th\x8he\x8er\x8r·c\x8cl\x8la\x8as\x8ss\x8se\x8es\x8s·r\x8re\x8el\x8la\x8at\x8te\x8ed\x8d·t\x8to\x8o·i\x8it\x8te\x8em\x8ms\x8s_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*
328 ··c\x8cl\x8la\x8as\x8ss\x8s·scrapy.item.ItemMeta(c\x8cl\x8la\x8as\x8ss\x8s_\x8_n\x8na\x8am\x8me\x8e,·b\x8ba\x8as\x8se\x8es\x8s,·a\x8at\x8tt\x8tr\x8rs\x8s)_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x8328 ··c\x8cl\x8la\x8as\x8ss\x8s·scrapy.item.ItemMeta(c\x8cl\x8la\x8as\x8ss\x8s_\x8_n\x8na\x8am\x8me\x8e,·b\x8ba\x8as\x8se\x8es\x8s,·a\x8at\x8tt\x8tr\x8rs\x8s)_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x8
329 ······_\x8M_\x8e_\x8t_\x8a_\x8c_\x8l_\x8a_\x8s_\x8s·of·Item·that·handles·field·definitions.329 ······_\x8M_\x8e_\x8t_\x8a_\x8c_\x8l_\x8a_\x8s_\x8s·of·Item·that·handles·field·definitions.
330 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t330 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
331 ===============================================================================331 ===============================================================================
332 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.332 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
333 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.333 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.71 KB
./usr/share/doc/python-scrapy-doc/html/topics/jobs.html
    
Offset 237, 15 lines modifiedOffset 237, 15 lines modified
237 ········<a·href="benchmarking.html"·class="btn·btn-neutral·float-left"·title="Benchmarking"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>237 ········<a·href="benchmarking.html"·class="btn·btn-neutral·float-left"·title="Benchmarking"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
238 ········<a·href="coroutines.html"·class="btn·btn-neutral·float-right"·title="Coroutines"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>238 ········<a·href="coroutines.html"·class="btn·btn-neutral·float-right"·title="Coroutines"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
239 ····</div>239 ····</div>
  
240 ··<hr/>240 ··<hr/>
  
241 ··<div·role="contentinfo">241 ··<div·role="contentinfo">
242 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.242 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
243 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.243 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
244 ······</span></p>244 ······</span></p>
245 ··</div>245 ··</div>
  
246 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a246 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
247 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>247 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
248 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.248 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
757 B
html2text {}
    
Offset 110, 9 lines modifiedOffset 110, 9 lines modified
110 except·for·the·callback·and·errback·values·passed·to·their·__init__·method,110 except·for·the·callback·and·errback·values·passed·to·their·__init__·method,
111 which·must·be·methods·of·the·running·_\x8S_\x8p_\x8i_\x8d_\x8e_\x8r·class.111 which·must·be·methods·of·the·running·_\x8S_\x8p_\x8i_\x8d_\x8e_\x8r·class.
112 If·you·wish·to·log·the·requests·that·couldn’t·be·serialized,·you·can·set·the112 If·you·wish·to·log·the·requests·that·couldn’t·be·serialized,·you·can·set·the
113 _\x8S_\x8C_\x8H_\x8E_\x8D_\x8U_\x8L_\x8E_\x8R_\x8__\x8D_\x8E_\x8B_\x8U_\x8G·setting·to·True·in·the·project’s·settings·page.·It·is·False·by113 _\x8S_\x8C_\x8H_\x8E_\x8D_\x8U_\x8L_\x8E_\x8R_\x8__\x8D_\x8E_\x8B_\x8U_\x8G·setting·to·True·in·the·project’s·settings·page.·It·is·False·by
114 default.114 default.
115 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t115 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
116 ===============================================================================116 ===============================================================================
117 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.117 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
118 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.118 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.96 KB
./usr/share/doc/python-scrapy-doc/html/topics/leaks.html
    
Offset 432, 15 lines modifiedOffset 432, 15 lines modified
432 ········<a·href="dynamic-content.html"·class="btn·btn-neutral·float-left"·title="Selecting·dynamically-loaded·content"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>432 ········<a·href="dynamic-content.html"·class="btn·btn-neutral·float-left"·title="Selecting·dynamically-loaded·content"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
433 ········<a·href="media-pipeline.html"·class="btn·btn-neutral·float-right"·title="Downloading·and·processing·files·and·images"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>433 ········<a·href="media-pipeline.html"·class="btn·btn-neutral·float-right"·title="Downloading·and·processing·files·and·images"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
434 ····</div>434 ····</div>
  
435 ··<hr/>435 ··<hr/>
  
436 ··<div·role="contentinfo">436 ··<div·role="contentinfo">
437 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.437 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
438 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.438 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
439 ······</span></p>439 ······</span></p>
440 ··</div>440 ··</div>
  
441 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a441 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
442 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>442 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
443 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.443 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
949 B
html2text {}
    
Offset 256, 9 lines modifiedOffset 256, 9 lines modified
256 ·····c\x8co\x8ol\x8ll\x8le\x8ec\x8ct\x8to\x8or\x8r,\x8,·w\x8wh\x8hi\x8ic\x8ch\x8h·i\x8is\x8s·a\x8ab\x8bl\x8le\x8e·t\x8to\x8o·m\x8mo\x8ov\x8ve\x8e·o\x8ob\x8bj\x8je\x8ec\x8ct\x8ts\x8s·i\x8in\x8n·m\x8me\x8em\x8mo\x8or\x8ry\x8y.\x8.·T\x8Th\x8hi\x8is\x8s·w\x8wo\x8ou\x8ul\x8ld\x8d256 ·····c\x8co\x8ol\x8ll\x8le\x8ec\x8ct\x8to\x8or\x8r,\x8,·w\x8wh\x8hi\x8ic\x8ch\x8h·i\x8is\x8s·a\x8ab\x8bl\x8le\x8e·t\x8to\x8o·m\x8mo\x8ov\x8ve\x8e·o\x8ob\x8bj\x8je\x8ec\x8ct\x8ts\x8s·i\x8in\x8n·m\x8me\x8em\x8mo\x8or\x8ry\x8y.\x8.·T\x8Th\x8hi\x8is\x8s·w\x8wo\x8ou\x8ul\x8ld\x8d
257 ·····r\x8re\x8eq\x8qu\x8ui\x8ir\x8re\x8e·s\x8si\x8ig\x8gn\x8ni\x8if\x8fi\x8ic\x8ca\x8an\x8nt\x8t·c\x8ch\x8ha\x8an\x8ng\x8ge\x8es\x8s·t\x8to\x8o·t\x8th\x8he\x8e·P\x8Py\x8yt\x8th\x8ho\x8on\x8n·i\x8in\x8nt\x8te\x8er\x8rp\x8pr\x8re\x8et\x8te\x8er\x8r.\x8.257 ·····r\x8re\x8eq\x8qu\x8ui\x8ir\x8re\x8e·s\x8si\x8ig\x8gn\x8ni\x8if\x8fi\x8ic\x8ca\x8an\x8nt\x8t·c\x8ch\x8ha\x8an\x8ng\x8ge\x8es\x8s·t\x8to\x8o·t\x8th\x8he\x8e·P\x8Py\x8yt\x8th\x8ho\x8on\x8n·i\x8in\x8nt\x8te\x8er\x8rp\x8pr\x8re\x8et\x8te\x8er\x8r.\x8.
258 To·keep·memory·consumption·reasonable·you·can·split·the·job·into·several258 To·keep·memory·consumption·reasonable·you·can·split·the·job·into·several
259 smaller·jobs·or·enable·_\x8p_\x8e_\x8r_\x8s_\x8i_\x8s_\x8t_\x8e_\x8n_\x8t_\x8·_\x8j_\x8o_\x8b_\x8·_\x8q_\x8u_\x8e_\x8u_\x8e·and·stop/start·spider·from·time·to259 smaller·jobs·or·enable·_\x8p_\x8e_\x8r_\x8s_\x8i_\x8s_\x8t_\x8e_\x8n_\x8t_\x8·_\x8j_\x8o_\x8b_\x8·_\x8q_\x8u_\x8e_\x8u_\x8e·and·stop/start·spider·from·time·to
260 time.260 time.
261 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t261 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
262 ===============================================================================262 ===============================================================================
263 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.263 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
264 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.264 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.74 KB
./usr/share/doc/python-scrapy-doc/html/topics/link-extractors.html
    
Offset 319, 15 lines modifiedOffset 319, 15 lines modified
319 ········<a·href="request-response.html"·class="btn·btn-neutral·float-left"·title="Requests·and·Responses"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>319 ········<a·href="request-response.html"·class="btn·btn-neutral·float-left"·title="Requests·and·Responses"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
320 ········<a·href="settings.html"·class="btn·btn-neutral·float-right"·title="Settings"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>320 ········<a·href="settings.html"·class="btn·btn-neutral·float-right"·title="Settings"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
321 ····</div>321 ····</div>
  
322 ··<hr/>322 ··<hr/>
  
323 ··<div·role="contentinfo">323 ··<div·role="contentinfo">
324 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.324 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
325 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.325 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
326 ······</span></p>326 ······</span></p>
327 ··</div>327 ··</div>
  
328 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a328 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
329 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>329 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
330 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.330 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
763 B
html2text {}
    
Offset 107, 9 lines modifiedOffset 107, 9 lines modified
107 ··················Dont·follow·this·one.107 ··················Dont·follow·this·one.
108 ················*·f\x8fr\x8ra\x8ag\x8gm\x8me\x8en\x8nt\x8t·–·the·part·of·the·url·after·the·hash·symbol.·From108 ················*·f\x8fr\x8ra\x8ag\x8gm\x8me\x8en\x8nt\x8t·–·the·part·of·the·url·after·the·hash·symbol.·From
109 ··················the·sample,·this·is·foo.109 ··················the·sample,·this·is·foo.
110 ················*·n\x8no\x8of\x8fo\x8ol\x8ll\x8lo\x8ow\x8w·–·an·indication·of·the·presence·or·absence·of·a110 ················*·n\x8no\x8of\x8fo\x8ol\x8ll\x8lo\x8ow\x8w·–·an·indication·of·the·presence·or·absence·of·a
111 ··················nofollow·value·in·the·rel·attribute·of·the·anchor·tag.111 ··················nofollow·value·in·the·rel·attribute·of·the·anchor·tag.
112 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t112 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
113 ===============================================================================113 ===============================================================================
114 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.114 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
115 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.115 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.68 KB
./usr/share/doc/python-scrapy-doc/html/topics/loaders.html
    
Offset 891, 15 lines modifiedOffset 891, 15 lines modified
891 ········<a·href="items.html"·class="btn·btn-neutral·float-left"·title="Items"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>891 ········<a·href="items.html"·class="btn·btn-neutral·float-left"·title="Items"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
892 ········<a·href="shell.html"·class="btn·btn-neutral·float-right"·title="Scrapy·shell"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>892 ········<a·href="shell.html"·class="btn·btn-neutral·float-right"·title="Scrapy·shell"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
893 ····</div>893 ····</div>
  
894 ··<hr/>894 ··<hr/>
  
895 ··<div·role="contentinfo">895 ··<div·role="contentinfo">
896 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.896 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
897 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.897 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
898 ······</span></p>898 ······</span></p>
899 ··</div>899 ··</div>
  
900 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a900 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
901 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>901 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
902 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.902 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
739 B
html2text {}
    
Offset 566, 9 lines modifiedOffset 566, 9 lines modified
566 There·are·many·other·possible·ways·to·extend,·inherit·and·override·your·Item566 There·are·many·other·possible·ways·to·extend,·inherit·and·override·your·Item
567 Loaders,·and·different·Item·Loaders·hierarchies·may·fit·better·for·different567 Loaders,·and·different·Item·Loaders·hierarchies·may·fit·better·for·different
568 projects.·Scrapy·only·provides·the·mechanism;·it·doesn’t·impose·any·specific568 projects.·Scrapy·only·provides·the·mechanism;·it·doesn’t·impose·any·specific
569 organization·of·your·Loaders·collection·-·that’s·up·to·you·and·your·project’s569 organization·of·your·Loaders·collection·-·that’s·up·to·you·and·your·project’s
570 needs.570 needs.
571 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t571 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
572 ===============================================================================572 ===============================================================================
573 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.573 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
574 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.574 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.62 KB
./usr/share/doc/python-scrapy-doc/html/topics/logging.html
    
Offset 586, 15 lines modifiedOffset 586, 15 lines modified
586 ········<a·href="exceptions.html"·class="btn·btn-neutral·float-left"·title="Exceptions"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>586 ········<a·href="exceptions.html"·class="btn·btn-neutral·float-left"·title="Exceptions"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
587 ········<a·href="stats.html"·class="btn·btn-neutral·float-right"·title="Stats·Collection"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>587 ········<a·href="stats.html"·class="btn·btn-neutral·float-right"·title="Stats·Collection"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
588 ····</div>588 ····</div>
  
589 ··<hr/>589 ··<hr/>
  
590 ··<div·role="contentinfo">590 ··<div·role="contentinfo">
591 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.591 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
592 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.592 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
593 ······</span></p>593 ······</span></p>
594 ··</div>594 ··</div>
  
595 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a595 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
596 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>596 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
597 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.597 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
663 B
html2text {}
    
Offset 362, 9 lines modifiedOffset 362, 9 lines modified
362 ··········filename="log.txt",·format="%(levelname)s:·%(message)s",362 ··········filename="log.txt",·format="%(levelname)s:·%(message)s",
363 ······level=logging.INFO363 ······level=logging.INFO
364 ······)364 ······)
365 ······Refer·to·_\x8R_\x8u_\x8n_\x8·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y_\x8·_\x8f_\x8r_\x8o_\x8m_\x8·_\x8a_\x8·_\x8s_\x8c_\x8r_\x8i_\x8p_\x8t·for·more·details·about·using·Scrapy365 ······Refer·to·_\x8R_\x8u_\x8n_\x8·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y_\x8·_\x8f_\x8r_\x8o_\x8m_\x8·_\x8a_\x8·_\x8s_\x8c_\x8r_\x8i_\x8p_\x8t·for·more·details·about·using·Scrapy
366 ······this·way.366 ······this·way.
367 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t367 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
368 ===============================================================================368 ===============================================================================
369 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.369 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
370 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.370 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.7 KB
./usr/share/doc/python-scrapy-doc/html/topics/media-pipeline.html
    
Offset 816, 15 lines modifiedOffset 816, 15 lines modified
816 ········<a·href="leaks.html"·class="btn·btn-neutral·float-left"·title="Debugging·memory·leaks"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>816 ········<a·href="leaks.html"·class="btn·btn-neutral·float-left"·title="Debugging·memory·leaks"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
817 ········<a·href="deploy.html"·class="btn·btn-neutral·float-right"·title="Deploying·Spiders"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>817 ········<a·href="deploy.html"·class="btn·btn-neutral·float-right"·title="Deploying·Spiders"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
818 ····</div>818 ····</div>
  
819 ··<hr/>819 ··<hr/>
  
820 ··<div·role="contentinfo">820 ··<div·role="contentinfo">
821 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.821 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
822 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.822 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
823 ······</span></p>823 ······</span></p>
824 ··</div>824 ··</div>
  
825 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a825 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
826 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>826 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
827 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.827 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
723 B
html2text {}
    
Offset 525, 9 lines modifiedOffset 525, 9 lines modified
525 ········adapter["image_paths"]·=·image_paths525 ········adapter["image_paths"]·=·image_paths
526 ········return·item526 ········return·item
527 To·enable·your·custom·media·pipeline·component·you·must·add·its·class·import527 To·enable·your·custom·media·pipeline·component·you·must·add·its·class·import
528 path·to·the·_\x8I_\x8T_\x8E_\x8M_\x8__\x8P_\x8I_\x8P_\x8E_\x8L_\x8I_\x8N_\x8E_\x8S·setting,·like·in·the·following·example:528 path·to·the·_\x8I_\x8T_\x8E_\x8M_\x8__\x8P_\x8I_\x8P_\x8E_\x8L_\x8I_\x8N_\x8E_\x8S·setting,·like·in·the·following·example:
529 ITEM_PIPELINES·=·{"myproject.pipelines.MyImagesPipeline":·300}529 ITEM_PIPELINES·=·{"myproject.pipelines.MyImagesPipeline":·300}
530 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t530 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
531 ===============================================================================531 ===============================================================================
532 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.532 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
533 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.533 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.71 KB
./usr/share/doc/python-scrapy-doc/html/topics/practices.html
    
Offset 420, 15 lines modifiedOffset 420, 15 lines modified
420 ········<a·href="contracts.html"·class="btn·btn-neutral·float-left"·title="Spiders·Contracts"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>420 ········<a·href="contracts.html"·class="btn·btn-neutral·float-left"·title="Spiders·Contracts"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
421 ········<a·href="broad-crawls.html"·class="btn·btn-neutral·float-right"·title="Broad·Crawls"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>421 ········<a·href="broad-crawls.html"·class="btn·btn-neutral·float-right"·title="Broad·Crawls"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
422 ····</div>422 ····</div>
  
423 ··<hr/>423 ··<hr/>
  
424 ··<div·role="contentinfo">424 ··<div·role="contentinfo">
425 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.425 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
426 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.426 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
427 ······</span></p>427 ······</span></p>
428 ··</div>428 ··</div>
  
429 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a429 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
430 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>430 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
431 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.431 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
742 B
html2text {}
    
Offset 286, 9 lines modifiedOffset 286, 9 lines modified
286 ······proxy·that·you·can·attach·your·own·proxies·to.286 ······proxy·that·you·can·attach·your·own·proxies·to.
287 ····*·use·a·ban·avoidance·service,·such·as·_\x8Z_\x8y_\x8t_\x8e_\x8·_\x8A_\x8P_\x8I,·which·provides·a·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y287 ····*·use·a·ban·avoidance·service,·such·as·_\x8Z_\x8y_\x8t_\x8e_\x8·_\x8A_\x8P_\x8I,·which·provides·a·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y
288 ······_\x8p_\x8l_\x8u_\x8g_\x8i_\x8n288 ······_\x8p_\x8l_\x8u_\x8g_\x8i_\x8n
289 If·you·are·still·unable·to·prevent·your·bot·getting·banned,·consider·contacting289 If·you·are·still·unable·to·prevent·your·bot·getting·banned,·consider·contacting
290 _\x8c_\x8o_\x8m_\x8m_\x8e_\x8r_\x8c_\x8i_\x8a_\x8l_\x8·_\x8s_\x8u_\x8p_\x8p_\x8o_\x8r_\x8t.290 _\x8c_\x8o_\x8m_\x8m_\x8e_\x8r_\x8c_\x8i_\x8a_\x8l_\x8·_\x8s_\x8u_\x8p_\x8p_\x8o_\x8r_\x8t.
291 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t291 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
292 ===============================================================================292 ===============================================================================
293 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.293 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
294 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.294 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.86 KB
./usr/share/doc/python-scrapy-doc/html/topics/request-response.html
    
Offset 1723, 15 lines modifiedOffset 1723, 15 lines modified
1723 ········<a·href="feed-exports.html"·class="btn·btn-neutral·float-left"·title="Feed·exports"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>1723 ········<a·href="feed-exports.html"·class="btn·btn-neutral·float-left"·title="Feed·exports"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
1724 ········<a·href="link-extractors.html"·class="btn·btn-neutral·float-right"·title="Link·Extractors"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>1724 ········<a·href="link-extractors.html"·class="btn·btn-neutral·float-right"·title="Link·Extractors"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
1725 ····</div>1725 ····</div>
  
1726 ··<hr/>1726 ··<hr/>
  
1727 ··<div·role="contentinfo">1727 ··<div·role="contentinfo">
1728 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.1728 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
1729 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.1729 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
1730 ······</span></p>1730 ······</span></p>
1731 ··</div>1731 ··</div>
  
1732 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a1732 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
1733 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>1733 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
1734 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.1734 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
877 B
html2text {}
    
Offset 1075, 9 lines modifiedOffset 1075, 9 lines modified
1075 *\x8**\x8**\x8**\x8*·X\x8Xm\x8ml\x8lR\x8Re\x8es\x8sp\x8po\x8on\x8ns\x8se\x8e·o\x8ob\x8bj\x8je\x8ec\x8ct\x8ts\x8s_\x8?\x8·*\x8**\x8**\x8**\x8*1075 *\x8**\x8**\x8**\x8*·X\x8Xm\x8ml\x8lR\x8Re\x8es\x8sp\x8po\x8on\x8ns\x8se\x8e·o\x8ob\x8bj\x8je\x8ec\x8ct\x8ts\x8s_\x8?\x8·*\x8**\x8**\x8**\x8*
1076 ··c\x8cl\x8la\x8as\x8ss\x8s·scrapy.http.XmlResponse(u\x8ur\x8rl\x8l[,·.\x8..\x8..\x8.])_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x81076 ··c\x8cl\x8la\x8as\x8ss\x8s·scrapy.http.XmlResponse(u\x8ur\x8rl\x8l[,·.\x8..\x8..\x8.])_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x8
1077 ······The·_\x8X_\x8m_\x8l_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e·class·is·a·subclass·of·_\x8T_\x8e_\x8x_\x8t_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e·which·adds·encoding1077 ······The·_\x8X_\x8m_\x8l_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e·class·is·a·subclass·of·_\x8T_\x8e_\x8x_\x8t_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e·which·adds·encoding
1078 ······auto-discovering·support·by·looking·into·the·XML·declaration·line.·See1078 ······auto-discovering·support·by·looking·into·the·XML·declaration·line.·See
1079 ······_\x8T_\x8e_\x8x_\x8t_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e_\x8._\x8e_\x8n_\x8c_\x8o_\x8d_\x8i_\x8n_\x8g.1079 ······_\x8T_\x8e_\x8x_\x8t_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e_\x8._\x8e_\x8n_\x8c_\x8o_\x8d_\x8i_\x8n_\x8g.
1080 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t1080 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
1081 ===============================================================================1081 ===============================================================================
1082 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.1082 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
1083 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.1083 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.73 KB
./usr/share/doc/python-scrapy-doc/html/topics/scheduler.html
    
Offset 373, 15 lines modifiedOffset 373, 15 lines modified
373 ········<a·href="signals.html"·class="btn·btn-neutral·float-left"·title="Signals"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>373 ········<a·href="signals.html"·class="btn·btn-neutral·float-left"·title="Signals"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
374 ········<a·href="exporters.html"·class="btn·btn-neutral·float-right"·title="Item·Exporters"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>374 ········<a·href="exporters.html"·class="btn·btn-neutral·float-right"·title="Item·Exporters"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
375 ····</div>375 ····</div>
  
376 ··<hr/>376 ··<hr/>
  
377 ··<div·role="contentinfo">377 ··<div·role="contentinfo">
378 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.378 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
379 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.379 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
380 ······</span></p>380 ······</span></p>
381 ··</div>381 ··</div>
  
382 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a382 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
383 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>383 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
384 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.384 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
780 B
html2text {}
    
Offset 205, 9 lines modifiedOffset 205, 9 lines modified
205 ········open(s\x8sp\x8pi\x8id\x8de\x8er\x8r:\x8:·_\x8S\x8S_\x8p\x8p_\x8i\x8i_\x8d\x8d_\x8e\x8e_\x8r\x8r)·→·_\x8D_\x8e_\x8f_\x8e_\x8r_\x8r_\x8e_\x8d·|·_\x8N_\x8o_\x8n_\x8e_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x8205 ········open(s\x8sp\x8pi\x8id\x8de\x8er\x8r:\x8:·_\x8S\x8S_\x8p\x8p_\x8i\x8i_\x8d\x8d_\x8e\x8e_\x8r\x8r)·→·_\x8D_\x8e_\x8f_\x8e_\x8r_\x8r_\x8e_\x8d·|·_\x8N_\x8o_\x8n_\x8e_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x8
206 ···············1.·initialize·the·memory·queue206 ···············1.·initialize·the·memory·queue
207 ···············2.·initialize·the·disk·queue·if·the·jobdir·attribute·is·a·valid207 ···············2.·initialize·the·disk·queue·if·the·jobdir·attribute·is·a·valid
208 ··················directory208 ··················directory
209 ···············3.·return·the·result·of·the·dupefilter’s·open·method209 ···············3.·return·the·result·of·the·dupefilter’s·open·method
210 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t210 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
211 ===============================================================================211 ===============================================================================
212 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.212 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
213 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.213 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.42 KB
./usr/share/doc/python-scrapy-doc/html/topics/scrapyd.html
    
Offset 160, 15 lines modifiedOffset 160, 15 lines modified
160 ···········</div>160 ···········</div>
161 ··········</div>161 ··········</div>
162 ··········<footer>162 ··········<footer>
  
163 ··<hr/>163 ··<hr/>
  
164 ··<div·role="contentinfo">164 ··<div·role="contentinfo">
165 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.165 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
166 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.166 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
167 ······</span></p>167 ······</span></p>
168 ··</div>168 ··</div>
  
169 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a169 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
170 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>170 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
171 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.171 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
796 B
html2text {}
    
Offset 60, 9 lines modifiedOffset 60, 9 lines modified
60 ····*·_\x8V_\x8i_\x8e_\x8w_\x8·_\x8p_\x8a_\x8g_\x8e_\x8·_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e60 ····*·_\x8V_\x8i_\x8e_\x8w_\x8·_\x8p_\x8a_\x8g_\x8e_\x8·_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e
61 ===============================================================================61 ===============================================================================
62 *\x8**\x8**\x8**\x8**\x8**\x8*·S\x8Sc\x8cr\x8ra\x8ap\x8py\x8yd\x8d_\x8?\x8·*\x8**\x8**\x8**\x8**\x8**\x8*62 *\x8**\x8**\x8**\x8**\x8**\x8*·S\x8Sc\x8cr\x8ra\x8ap\x8py\x8yd\x8d_\x8?\x8·*\x8**\x8**\x8**\x8**\x8**\x8*
63 Scrapyd·has·been·moved·into·a·separate·project.63 Scrapyd·has·been·moved·into·a·separate·project.
64 Its·documentation·is·now·hosted·at:64 Its·documentation·is·now·hosted·at:
65 ·····_\x8h_\x8t_\x8t_\x8p_\x8s_\x8:_\x8/_\x8/_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8d_\x8._\x8r_\x8e_\x8a_\x8d_\x8t_\x8h_\x8e_\x8d_\x8o_\x8c_\x8s_\x8._\x8i_\x8o_\x8/_\x8e_\x8n_\x8/_\x8l_\x8a_\x8t_\x8e_\x8s_\x8t_\x8/65 ·····_\x8h_\x8t_\x8t_\x8p_\x8s_\x8:_\x8/_\x8/_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8d_\x8._\x8r_\x8e_\x8a_\x8d_\x8t_\x8h_\x8e_\x8d_\x8o_\x8c_\x8s_\x8._\x8i_\x8o_\x8/_\x8e_\x8n_\x8/_\x8l_\x8a_\x8t_\x8e_\x8s_\x8t_\x8/
66 ===============================================================================66 ===============================================================================
67 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.67 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
68 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.68 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.64 KB
./usr/share/doc/python-scrapy-doc/html/topics/selectors.html
    
Offset 1358, 15 lines modifiedOffset 1358, 15 lines modified
1358 ········<a·href="spiders.html"·class="btn·btn-neutral·float-left"·title="Spiders"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>1358 ········<a·href="spiders.html"·class="btn·btn-neutral·float-left"·title="Spiders"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
1359 ········<a·href="items.html"·class="btn·btn-neutral·float-right"·title="Items"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>1359 ········<a·href="items.html"·class="btn·btn-neutral·float-right"·title="Items"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
1360 ····</div>1360 ····</div>
  
1361 ··<hr/>1361 ··<hr/>
  
1362 ··<div·role="contentinfo">1362 ··<div·role="contentinfo">
1363 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.1363 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
1364 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.1364 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
1365 ······</span></p>1365 ······</span></p>
1366 ··</div>1366 ··</div>
  
1367 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a1367 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
1368 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>1368 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
1369 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.1369 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
696 B
html2text {}
    
Offset 931, 9 lines modifiedOffset 931, 9 lines modified
931 ······sel.xpath("//product")931 ······sel.xpath("//product")
932 ···2.·Extract·all·prices·from·a·_\x8G_\x8o_\x8o_\x8g_\x8l_\x8e_\x8·_\x8B_\x8a_\x8s_\x8e_\x8·_\x8X_\x8M_\x8L_\x8·_\x8f_\x8e_\x8e_\x8d·which·requires·registering932 ···2.·Extract·all·prices·from·a·_\x8G_\x8o_\x8o_\x8g_\x8l_\x8e_\x8·_\x8B_\x8a_\x8s_\x8e_\x8·_\x8X_\x8M_\x8L_\x8·_\x8f_\x8e_\x8e_\x8d·which·requires·registering
933 ······a·namespace:933 ······a·namespace:
934 ······sel.register_namespace("g",·"http://base.google.com/ns/1.0")934 ······sel.register_namespace("g",·"http://base.google.com/ns/1.0")
935 ······sel.xpath("//g:price").getall()935 ······sel.xpath("//g:price").getall()
936 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t936 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
937 ===============================================================================937 ===============================================================================
938 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.938 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
939 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.939 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.7 KB
./usr/share/doc/python-scrapy-doc/html/topics/settings.html
    
Offset 1674, 15 lines modifiedOffset 1674, 15 lines modified
1674 ········<a·href="link-extractors.html"·class="btn·btn-neutral·float-left"·title="Link·Extractors"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>1674 ········<a·href="link-extractors.html"·class="btn·btn-neutral·float-left"·title="Link·Extractors"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
1675 ········<a·href="exceptions.html"·class="btn·btn-neutral·float-right"·title="Exceptions"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>1675 ········<a·href="exceptions.html"·class="btn·btn-neutral·float-right"·title="Exceptions"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
1676 ····</div>1676 ····</div>
  
1677 ··<hr/>1677 ··<hr/>
  
1678 ··<div·role="contentinfo">1678 ··<div·role="contentinfo">
1679 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.1679 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
1680 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.1680 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
1681 ······</span></p>1681 ······</span></p>
1682 ··</div>1682 ··</div>
  
1683 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a1683 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
1684 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>1684 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
1685 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.1685 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
733 B
html2text {}
    
Offset 1178, 9 lines modifiedOffset 1178, 9 lines modified
1178 ····*·_\x8R_\x8E_\x8T_\x8R_\x8Y_\x8__\x8T_\x8I_\x8M_\x8E_\x8S1178 ····*·_\x8R_\x8E_\x8T_\x8R_\x8Y_\x8__\x8T_\x8I_\x8M_\x8E_\x8S
1179 ····*·_\x8T_\x8E_\x8L_\x8N_\x8E_\x8T_\x8C_\x8O_\x8N_\x8S_\x8O_\x8L_\x8E_\x8__\x8H_\x8O_\x8S_\x8T1179 ····*·_\x8T_\x8E_\x8L_\x8N_\x8E_\x8T_\x8C_\x8O_\x8N_\x8S_\x8O_\x8L_\x8E_\x8__\x8H_\x8O_\x8S_\x8T
1180 ····*·_\x8T_\x8E_\x8L_\x8N_\x8E_\x8T_\x8C_\x8O_\x8N_\x8S_\x8O_\x8L_\x8E_\x8__\x8P_\x8A_\x8S_\x8S_\x8W_\x8O_\x8R_\x8D1180 ····*·_\x8T_\x8E_\x8L_\x8N_\x8E_\x8T_\x8C_\x8O_\x8N_\x8S_\x8O_\x8L_\x8E_\x8__\x8P_\x8A_\x8S_\x8S_\x8W_\x8O_\x8R_\x8D
1181 ····*·_\x8T_\x8E_\x8L_\x8N_\x8E_\x8T_\x8C_\x8O_\x8N_\x8S_\x8O_\x8L_\x8E_\x8__\x8P_\x8O_\x8R_\x8T1181 ····*·_\x8T_\x8E_\x8L_\x8N_\x8E_\x8T_\x8C_\x8O_\x8N_\x8S_\x8O_\x8L_\x8E_\x8__\x8P_\x8O_\x8R_\x8T
1182 ····*·_\x8T_\x8E_\x8L_\x8N_\x8E_\x8T_\x8C_\x8O_\x8N_\x8S_\x8O_\x8L_\x8E_\x8__\x8U_\x8S_\x8E_\x8R_\x8N_\x8A_\x8M_\x8E1182 ····*·_\x8T_\x8E_\x8L_\x8N_\x8E_\x8T_\x8C_\x8O_\x8N_\x8S_\x8O_\x8L_\x8E_\x8__\x8U_\x8S_\x8E_\x8R_\x8N_\x8A_\x8M_\x8E
1183 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t1183 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
1184 ===============================================================================1184 ===============================================================================
1185 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.1185 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
1186 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.1186 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.61 KB
./usr/share/doc/python-scrapy-doc/html/topics/shell.html
    
Offset 433, 15 lines modifiedOffset 433, 15 lines modified
433 ········<a·href="loaders.html"·class="btn·btn-neutral·float-left"·title="Item·Loaders"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>433 ········<a·href="loaders.html"·class="btn·btn-neutral·float-left"·title="Item·Loaders"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
434 ········<a·href="item-pipeline.html"·class="btn·btn-neutral·float-right"·title="Item·Pipeline"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>434 ········<a·href="item-pipeline.html"·class="btn·btn-neutral·float-right"·title="Item·Pipeline"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
435 ····</div>435 ····</div>
  
436 ··<hr/>436 ··<hr/>
  
437 ··<div·role="contentinfo">437 ··<div·role="contentinfo">
438 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.438 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
439 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.439 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
440 ······</span></p>440 ······</span></p>
441 ··</div>441 ··</div>
  
442 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a442 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
443 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>443 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
444 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.444 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
657 B
html2text {}
    
Offset 280, 9 lines modifiedOffset 280, 9 lines modified
280 example.net>·(referer:·None)280 example.net>·(referer:·None)
281 ...281 ...
282 Note·that·you·can’t·use·the·fetch·shortcut·here·since·the·Scrapy·engine·is282 Note·that·you·can’t·use·the·fetch·shortcut·here·since·the·Scrapy·engine·is
283 blocked·by·the·shell.·However,·after·you·leave·the·shell,·the·spider·will283 blocked·by·the·shell.·However,·after·you·leave·the·shell,·the·spider·will
284 continue·crawling·where·it·stopped,·as·shown·above.284 continue·crawling·where·it·stopped,·as·shown·above.
285 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t285 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
286 ===============================================================================286 ===============================================================================
287 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.287 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
288 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.288 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.72 KB
./usr/share/doc/python-scrapy-doc/html/topics/signals.html
    
Offset 707, 15 lines modifiedOffset 707, 15 lines modified
707 ········<a·href="extensions.html"·class="btn·btn-neutral·float-left"·title="Extensions"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>707 ········<a·href="extensions.html"·class="btn·btn-neutral·float-left"·title="Extensions"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
708 ········<a·href="scheduler.html"·class="btn·btn-neutral·float-right"·title="Scheduler"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>708 ········<a·href="scheduler.html"·class="btn·btn-neutral·float-right"·title="Scheduler"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
709 ····</div>709 ····</div>
  
710 ··<hr/>710 ··<hr/>
  
711 ··<div·role="contentinfo">711 ··<div·role="contentinfo">
712 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.712 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
713 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.713 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
714 ······</span></p>714 ······</span></p>
715 ··</div>715 ··</div>
  
716 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a716 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
717 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>717 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
718 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.718 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
774 B
html2text {}
    
Offset 389, 9 lines modifiedOffset 389, 9 lines modified
389 ················*·r\x8re\x8es\x8sp\x8po\x8on\x8ns\x8se\x8e·(_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e·object)·–·the·response·downloaded389 ················*·r\x8re\x8es\x8sp\x8po\x8on\x8ns\x8se\x8e·(_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e·object)·–·the·response·downloaded
390 ················*·r\x8re\x8eq\x8qu\x8ue\x8es\x8st\x8t·(Request·object)·–·the·request·that·generated·the390 ················*·r\x8re\x8eq\x8qu\x8ue\x8es\x8st\x8t·(Request·object)·–·the·request·that·generated·the
391 ··················response391 ··················response
392 ················*·s\x8sp\x8pi\x8id\x8de\x8er\x8r·(_\x8S_\x8p_\x8i_\x8d_\x8e_\x8r·object)·–·the·spider·for·which·the·response·is392 ················*·s\x8sp\x8pi\x8id\x8de\x8er\x8r·(_\x8S_\x8p_\x8i_\x8d_\x8e_\x8r·object)·–·the·spider·for·which·the·response·is
393 ··················intended393 ··················intended
394 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t394 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
395 ===============================================================================395 ===============================================================================
396 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.396 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
397 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.397 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.78 KB
./usr/share/doc/python-scrapy-doc/html/topics/spider-middleware.html
    
Offset 722, 15 lines modifiedOffset 722, 15 lines modified
722 ········<a·href="downloader-middleware.html"·class="btn·btn-neutral·float-left"·title="Downloader·Middleware"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>722 ········<a·href="downloader-middleware.html"·class="btn·btn-neutral·float-left"·title="Downloader·Middleware"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
723 ········<a·href="extensions.html"·class="btn·btn-neutral·float-right"·title="Extensions"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>723 ········<a·href="extensions.html"·class="btn·btn-neutral·float-right"·title="Extensions"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
724 ····</div>724 ····</div>
  
725 ··<hr/>725 ··<hr/>
  
726 ··<div·role="contentinfo">726 ··<div·role="contentinfo">
727 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.727 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
728 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.728 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
729 ······</span></p>729 ······</span></p>
730 ··</div>730 ··</div>
  
731 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a731 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
732 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>732 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
733 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.733 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
791 B
html2text {}
    
Offset 427, 9 lines modifiedOffset 427, 9 lines modified
427 ······Filters·out·requests·with·URLs·longer·than·URLLENGTH_LIMIT427 ······Filters·out·requests·with·URLs·longer·than·URLLENGTH_LIMIT
428 ······The·_\x8U_\x8r_\x8l_\x8L_\x8e_\x8n_\x8g_\x8t_\x8h_\x8M_\x8i_\x8d_\x8d_\x8l_\x8e_\x8w_\x8a_\x8r_\x8e·can·be·configured·through·the·following·settings428 ······The·_\x8U_\x8r_\x8l_\x8L_\x8e_\x8n_\x8g_\x8t_\x8h_\x8M_\x8i_\x8d_\x8d_\x8l_\x8e_\x8w_\x8a_\x8r_\x8e·can·be·configured·through·the·following·settings
429 ······(see·the·settings·documentation·for·more·info):429 ······(see·the·settings·documentation·for·more·info):
430 ···············*·_\x8U_\x8R_\x8L_\x8L_\x8E_\x8N_\x8G_\x8T_\x8H_\x8__\x8L_\x8I_\x8M_\x8I_\x8T·-·The·maximum·URL·length·to·allow·for430 ···············*·_\x8U_\x8R_\x8L_\x8L_\x8E_\x8N_\x8G_\x8T_\x8H_\x8__\x8L_\x8I_\x8M_\x8I_\x8T·-·The·maximum·URL·length·to·allow·for
431 ·················crawled·URLs.431 ·················crawled·URLs.
432 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t432 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
433 ===============================================================================433 ===============================================================================
434 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.434 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
435 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.435 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.54 KB
./usr/share/doc/python-scrapy-doc/html/topics/spiders.html
    
Offset 1140, 15 lines modifiedOffset 1140, 15 lines modified
1140 ········<a·href="commands.html"·class="btn·btn-neutral·float-left"·title="Command·line·tool"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>1140 ········<a·href="commands.html"·class="btn·btn-neutral·float-left"·title="Command·line·tool"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
1141 ········<a·href="selectors.html"·class="btn·btn-neutral·float-right"·title="Selectors"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>1141 ········<a·href="selectors.html"·class="btn·btn-neutral·float-right"·title="Selectors"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
1142 ····</div>1142 ····</div>
  
1143 ··<hr/>1143 ··<hr/>
  
1144 ··<div·role="contentinfo">1144 ··<div·role="contentinfo">
1145 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.1145 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
1146 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.1146 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
1147 ······</span></p>1147 ······</span></p>
1148 ··</div>1148 ··</div>
  
1149 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a1149 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
1150 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>1150 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
1151 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.1151 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
580 B
html2text {}
    
Offset 778, 9 lines modifiedOffset 778, 9 lines modified
778 ····def·parse_shop(self,·response):778 ····def·parse_shop(self,·response):
779 ········pass··#·...·scrape·shop·here·...779 ········pass··#·...·scrape·shop·here·...
  
780 ····def·parse_other(self,·response):780 ····def·parse_other(self,·response):
781 ········pass··#·...·scrape·other·here·...781 ········pass··#·...·scrape·other·here·...
782 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t782 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
783 ===============================================================================783 ===============================================================================
784 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.784 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
785 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.785 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.75 KB
./usr/share/doc/python-scrapy-doc/html/topics/stats.html
    
Offset 270, 15 lines modifiedOffset 270, 15 lines modified
270 ········<a·href="logging.html"·class="btn·btn-neutral·float-left"·title="Logging"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>270 ········<a·href="logging.html"·class="btn·btn-neutral·float-left"·title="Logging"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
271 ········<a·href="email.html"·class="btn·btn-neutral·float-right"·title="Sending·e-mail"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>271 ········<a·href="email.html"·class="btn·btn-neutral·float-right"·title="Sending·e-mail"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
272 ····</div>272 ····</div>
  
273 ··<hr/>273 ··<hr/>
  
274 ··<div·role="contentinfo">274 ··<div·role="contentinfo">
275 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.275 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
276 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.276 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
277 ······</span></p>277 ······</span></p>
278 ··</div>278 ··</div>
  
279 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a279 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
280 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>280 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
281 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.281 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
807 B
html2text {}
    
Offset 127, 9 lines modifiedOffset 127, 9 lines modified
127 ······A·Stats·collector·which·does·nothing·but·is·very·efficient·(because·it127 ······A·Stats·collector·which·does·nothing·but·is·very·efficient·(because·it
128 ······does·nothing).·This·stats·collector·can·be·set·via·the·_\x8S_\x8T_\x8A_\x8T_\x8S_\x8__\x8C_\x8L_\x8A_\x8S_\x8S128 ······does·nothing).·This·stats·collector·can·be·set·via·the·_\x8S_\x8T_\x8A_\x8T_\x8S_\x8__\x8C_\x8L_\x8A_\x8S_\x8S
129 ······setting,·to·disable·stats·collect·in·order·to·improve·performance.129 ······setting,·to·disable·stats·collect·in·order·to·improve·performance.
130 ······However,·the·performance·penalty·of·stats·collection·is·usually·marginal130 ······However,·the·performance·penalty·of·stats·collection·is·usually·marginal
131 ······compared·to·other·Scrapy·workload·like·parsing·pages.131 ······compared·to·other·Scrapy·workload·like·parsing·pages.
132 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t132 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
133 ===============================================================================133 ===============================================================================
134 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.134 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
135 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.135 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.64 KB
./usr/share/doc/python-scrapy-doc/html/topics/telnetconsole.html
    
Offset 369, 15 lines modifiedOffset 369, 15 lines modified
369 ········<a·href="email.html"·class="btn·btn-neutral·float-left"·title="Sending·e-mail"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>369 ········<a·href="email.html"·class="btn·btn-neutral·float-left"·title="Sending·e-mail"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
370 ········<a·href="../faq.html"·class="btn·btn-neutral·float-right"·title="Frequently·Asked·Questions"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>370 ········<a·href="../faq.html"·class="btn·btn-neutral·float-right"·title="Frequently·Asked·Questions"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
371 ····</div>371 ····</div>
  
372 ··<hr/>372 ··<hr/>
  
373 ··<div·role="contentinfo">373 ··<div·role="contentinfo">
374 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.374 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
375 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.375 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
376 ······</span></p>376 ······</span></p>
377 ··</div>377 ··</div>
  
378 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a378 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
379 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>379 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
380 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.380 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
664 B
html2text {}
    
Offset 183, 9 lines modifiedOffset 183, 9 lines modified
183 The·username·used·for·the·telnet·console183 The·username·used·for·the·telnet·console
184 *\x8**\x8**\x8**\x8*·T\x8TE\x8EL\x8LN\x8NE\x8ET\x8TC\x8CO\x8ON\x8NS\x8SO\x8OL\x8LE\x8E_\x8_P\x8PA\x8AS\x8SS\x8SW\x8WO\x8OR\x8RD\x8D_\x8?\x8·*\x8**\x8**\x8**\x8*184 *\x8**\x8**\x8**\x8*·T\x8TE\x8EL\x8LN\x8NE\x8ET\x8TC\x8CO\x8ON\x8NS\x8SO\x8OL\x8LE\x8E_\x8_P\x8PA\x8AS\x8SS\x8SW\x8WO\x8OR\x8RD\x8D_\x8?\x8·*\x8**\x8**\x8**\x8*
185 Default:·None185 Default:·None
186 The·password·used·for·the·telnet·console,·default·behaviour·is·to·have·it186 The·password·used·for·the·telnet·console,·default·behaviour·is·to·have·it
187 autogenerated187 autogenerated
188 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t188 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
189 ===============================================================================189 ===============================================================================
190 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.190 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
191 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.191 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.51 KB
./usr/share/doc/python-scrapy-doc/html/versioning.html
    
Offset 210, 15 lines modifiedOffset 210, 15 lines modified
210 ··········<footer><div·class="rst-footer-buttons"·role="navigation"·aria-label="Footer">210 ··········<footer><div·class="rst-footer-buttons"·role="navigation"·aria-label="Footer">
211 ········<a·href="contributing.html"·class="btn·btn-neutral·float-left"·title="Contributing·to·Scrapy"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>211 ········<a·href="contributing.html"·class="btn·btn-neutral·float-left"·title="Contributing·to·Scrapy"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
212 ····</div>212 ····</div>
  
213 ··<hr/>213 ··<hr/>
  
214 ··<div·role="contentinfo">214 ··<div·role="contentinfo">
215 ····<p>&#169;·Copyright·2008–2024,·Scrapy·developers.215 ····<p>&#169;·Copyright·2008–2025,·Scrapy·developers.
216 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.216 ······<span·class="lastupdated">Last·updated·on·Apr·24,·2024.
217 ······</span></p>217 ······</span></p>
218 ··</div>218 ··</div>
  
219 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a219 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
220 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>220 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
221 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.221 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
⊟
649 B
html2text {}
    
Offset 96, 9 lines modifiedOffset 96, 9 lines modified
96 14th·2021·or·before·that.96 14th·2021·or·before·that.
97 Any·new·Scrapy·release·after·a·year·m\x8ma\x8ay\x8y·remove·support·for·that·deprecated97 Any·new·Scrapy·release·after·a·year·m\x8ma\x8ay\x8y·remove·support·for·that·deprecated
98 feature.98 feature.
99 All·deprecated·features·removed·in·a·Scrapy·release·are·explicitly·mentioned·in99 All·deprecated·features·removed·in·a·Scrapy·release·are·explicitly·mentioned·in
100 the·_\x8r_\x8e_\x8l_\x8e_\x8a_\x8s_\x8e_\x8·_\x8n_\x8o_\x8t_\x8e_\x8s.100 the·_\x8r_\x8e_\x8l_\x8e_\x8a_\x8s_\x8e_\x8·_\x8n_\x8o_\x8t_\x8e_\x8s.
101 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s101 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s
102 ===============================================================================102 ===============================================================================
103 ©·Copyright·2008–2024,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.103 ©·Copyright·2008–2025,·Scrapy·developers.·Last·updated·on·Apr·24,·2024.
104 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.104 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
Generated by diffoscope 265