⊟
172 KB
/srv/reproducible-results/rbuild-debian/r-b-build.mdPxfLAY/b1/python-scrapy_2.12.0-1_amd64.changes vs.
/srv/reproducible-results/rbuild-debian/r-b-build.mdPxfLAY/b2/python-scrapy_2.12.0-1_amd64.changes
⊟
298 B
Files
    
Offset 1, 3 lines modifiedOffset 1, 3 lines modified
  
1 ·984b7245866fde8dd804249c8496b9a8·872652·doc·optional·python-scrapy-doc_2.12.0-1_all.deb1 ·ba5d0adda6980faf0e2f4eb6000b0ef0·872644·doc·optional·python-scrapy-doc_2.12.0-1_all.deb
2 ·9245c369c674ddcaf4ee0c81f205ba35·271636·python·optional·python3-scrapy_2.12.0-1_all.deb2 ·9245c369c674ddcaf4ee0c81f205ba35·271636·python·optional·python3-scrapy_2.12.0-1_all.deb
⊟
172 KB
python-scrapy-doc_2.12.0-1_all.deb
⊟
370 B
file list
    
Offset 1, 3 lines modifiedOffset 1, 3 lines modified
1 -rw-r--r--···0········0········0········4·2024-11-19·09:24:06.000000·debian-binary1 -rw-r--r--···0········0········0········4·2024-11-19·09:24:06.000000·debian-binary
2 -rw-r--r--···0········0········0·····5096·2024-11-19·09:24:06.000000·control.tar.xz2 -rw-r--r--···0········0········0·····5088·2024-11-19·09:24:06.000000·control.tar.xz
3 -rw-r--r--···0········0········0···867364·2024-11-19·09:24:06.000000·data.tar.xz3 -rw-r--r--···0········0········0···867364·2024-11-19·09:24:06.000000·data.tar.xz
⊟
98.0 B
control.tar.xz
⊟
70.0 B
control.tar
⊟
48.0 B
./md5sums
⊟
30.0 B
./md5sums
Files differ
⊟
171 KB
data.tar.xz
⊟
171 KB
data.tar
⊟
1.3 KB
./usr/share/doc/python-scrapy-doc/html/404.html
    
Offset 151, 15 lines modifiedOffset 151, 15 lines modified
151 ··········</div>151 ··········</div>
152 ··········<footer>152 ··········<footer>
  
153 ··<hr/>153 ··<hr/>
  
154 ··<div·role="contentinfo">154 ··<div·role="contentinfo">
155 ····<p>&#169;·Copyright·Scrapy·developers.155 ····<p>&#169;·Copyright·Scrapy·developers.
156 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.156 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
157 ······</span></p>157 ······</span></p>
158 ··</div>158 ··</div>
  
159 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a159 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
160 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>160 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
161 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.161 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
162 ···162 ···
⊟
714 B
html2text {}
    
Offset 56, 9 lines modifiedOffset 56, 9 lines modified
56 ····*·_\x8V_\x8e_\x8r_\x8s_\x8i_\x8o_\x8n_\x8i_\x8n_\x8g_\x8·_\x8a_\x8n_\x8d_\x8·_\x8A_\x8P_\x8I_\x8·_\x8s_\x8t_\x8a_\x8b_\x8i_\x8l_\x8i_\x8t_\x8y56 ····*·_\x8V_\x8e_\x8r_\x8s_\x8i_\x8o_\x8n_\x8i_\x8n_\x8g_\x8·_\x8a_\x8n_\x8d_\x8·_\x8A_\x8P_\x8I_\x8·_\x8s_\x8t_\x8a_\x8b_\x8i_\x8l_\x8i_\x8t_\x8y
57 _\x8S_\x8c_\x8r_\x8a_\x8p_\x8y57 _\x8S_\x8c_\x8r_\x8a_\x8p_\x8y
58 ····*·Page·not·found58 ····*·Page·not·found
59 ===============================================================================59 ===============================================================================
60 *\x8**\x8**\x8**\x8**\x8**\x8*·P\x8Pa\x8ag\x8ge\x8e·n\x8no\x8ot\x8t·f\x8fo\x8ou\x8un\x8nd\x8d·*\x8**\x8**\x8**\x8**\x8**\x8*60 *\x8**\x8**\x8**\x8**\x8**\x8*·P\x8Pa\x8ag\x8ge\x8e·n\x8no\x8ot\x8t·f\x8fo\x8ou\x8un\x8nd\x8d·*\x8**\x8**\x8**\x8**\x8**\x8*
61 Unfortunately·we·couldn't·find·the·content·you·were·looking·for.61 Unfortunately·we·couldn't·find·the·content·you·were·looking·for.
62 ===============================================================================62 ===============================================================================
63 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.63 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
64 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.64 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.24 KB
./usr/share/doc/python-scrapy-doc/html/README.html
    
Offset 205, 15 lines modifiedOffset 205, 15 lines modified
205 ··········</div>205 ··········</div>
206 ··········<footer>206 ··········<footer>
  
207 ··<hr/>207 ··<hr/>
  
208 ··<div·role="contentinfo">208 ··<div·role="contentinfo">
209 ····<p>&#169;·Copyright·Scrapy·developers.209 ····<p>&#169;·Copyright·Scrapy·developers.
210 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.210 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
211 ······</span></p>211 ······</span></p>
212 ··</div>212 ··</div>
  
213 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a213 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
214 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>214 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
215 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.215 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
216 ···216 ···
⊟
648 B
html2text {}
    
Offset 84, 9 lines modifiedOffset 84, 9 lines modified
84 make·watch84 make·watch
85 *\x8**\x8**\x8**\x8**\x8*·A\x8Al\x8lt\x8te\x8er\x8rn\x8na\x8at\x8ti\x8iv\x8ve\x8e·m\x8me\x8et\x8th\x8ho\x8od\x8d·u\x8us\x8si\x8in\x8ng\x8g·t\x8to\x8ox\x8x_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*85 *\x8**\x8**\x8**\x8**\x8*·A\x8Al\x8lt\x8te\x8er\x8rn\x8na\x8at\x8ti\x8iv\x8ve\x8e·m\x8me\x8et\x8th\x8ho\x8od\x8d·u\x8us\x8si\x8in\x8ng\x8g·t\x8to\x8ox\x8x_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*
86 To·compile·the·documentation·to·HTML·run·the·following·command:86 To·compile·the·documentation·to·HTML·run·the·following·command:
87 tox·-e·docs87 tox·-e·docs
88 Documentation·will·be·generated·(in·HTML·format)·inside·the·.tox/docs/tmp/html88 Documentation·will·be·generated·(in·HTML·format)·inside·the·.tox/docs/tmp/html
89 dir.89 dir.
90 ===============================================================================90 ===============================================================================
91 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.91 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
92 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.92 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.36 KB
./usr/share/doc/python-scrapy-doc/html/_modules/index.html
    
Offset 222, 15 lines modifiedOffset 222, 15 lines modified
222 ··········</div>222 ··········</div>
223 ··········<footer>223 ··········<footer>
  
224 ··<hr/>224 ··<hr/>
  
225 ··<div·role="contentinfo">225 ··<div·role="contentinfo">
226 ····<p>&#169;·Copyright·Scrapy·developers.226 ····<p>&#169;·Copyright·Scrapy·developers.
227 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.227 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
228 ······</span></p>228 ······</span></p>
229 ··</div>229 ··</div>
  
230 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a230 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
231 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>231 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
232 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.232 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
233 ···233 ···
⊟
759 B
html2text {}
    
Offset 127, 9 lines modifiedOffset 127, 9 lines modified
127 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8m_\x8i_\x8s_\x8c127 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8m_\x8i_\x8s_\x8c
128 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8p_\x8y_\x8t_\x8h_\x8o_\x8n128 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8p_\x8y_\x8t_\x8h_\x8o_\x8n
129 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8r_\x8e_\x8a_\x8c_\x8t_\x8o_\x8r129 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8r_\x8e_\x8a_\x8c_\x8t_\x8o_\x8r
130 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8r_\x8e_\x8q_\x8u_\x8e_\x8s_\x8t130 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8r_\x8e_\x8q_\x8u_\x8e_\x8s_\x8t
131 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8r_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e131 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8r_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e
132 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8t_\x8r_\x8a_\x8c_\x8k_\x8r_\x8e_\x8f132 ····*·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8t_\x8r_\x8a_\x8c_\x8k_\x8r_\x8e_\x8f
133 ===============================================================================133 ===============================================================================
134 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.134 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
135 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.135 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.27 KB
./usr/share/doc/python-scrapy-doc/html/_modules/itemloaders.html
    
Offset 852, 15 lines modifiedOffset 852, 15 lines modified
852 ··········</div>852 ··········</div>
853 ··········<footer>853 ··········<footer>
  
854 ··<hr/>854 ··<hr/>
  
855 ··<div·role="contentinfo">855 ··<div·role="contentinfo">
856 ····<p>&#169;·Copyright·Scrapy·developers.856 ····<p>&#169;·Copyright·Scrapy·developers.
857 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.857 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
858 ······</span></p>858 ······</span></p>
859 ··</div>859 ··</div>
  
860 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a860 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
861 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>861 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
862 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.862 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
863 ···863 ···
⊟
650 B
html2text {}
    
Offset 793, 9 lines modifiedOffset 793, 9 lines modified
793 ········jmess·=·arg_to_iter(jmess)793 ········jmess·=·arg_to_iter(jmess)
794 ········if·not·hasattr(self.selector,·"jmespath"):794 ········if·not·hasattr(self.selector,·"jmespath"):
795 ············raise·AttributeError(795 ············raise·AttributeError(
796 ················"Please·install·parsel·>=·1.8.1·to·get·jmespath·support"796 ················"Please·install·parsel·>=·1.8.1·to·get·jmespath·support"
797 ············)797 ············)
798 ········return·flatten(self.selector.jmespath(jmes).getall()·for·jmes·in·jmess)798 ········return·flatten(self.selector.jmespath(jmes).getall()·for·jmes·in·jmess)
799 ===============================================================================799 ===============================================================================
800 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.800 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
801 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.801 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.22 KB
./usr/share/doc/python-scrapy-doc/html/_modules/parsel/selector.html
    
Offset 1056, 15 lines modifiedOffset 1056, 15 lines modified
1056 ··········</div>1056 ··········</div>
1057 ··········<footer>1057 ··········<footer>
  
1058 ··<hr/>1058 ··<hr/>
  
1059 ··<div·role="contentinfo">1059 ··<div·role="contentinfo">
1060 ····<p>&#169;·Copyright·Scrapy·developers.1060 ····<p>&#169;·Copyright·Scrapy·developers.
1061 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.1061 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
1062 ······</span></p>1062 ······</span></p>
1063 ··</div>1063 ··</div>
  
1064 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a1064 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
1065 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>1065 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
1066 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.1066 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
1067 ···1067 ···
⊟
589 B
html2text {}
    
Offset 1003, 9 lines modifiedOffset 1003, 9 lines modified
1003 ····def·__str__(self)·->·str:1003 ····def·__str__(self)·->·str:
1004 ········return·str(self.get())1004 ········return·str(self.get())
  
1005 ····def·__repr__(self)·->·str:1005 ····def·__repr__(self)·->·str:
1006 ········data·=·repr(shorten(str(self.get()),·width=40))1006 ········data·=·repr(shorten(str(self.get()),·width=40))
1007 ········return·f"<{type(self).__name__}·query={self._expr!r}·data={data}>"1007 ········return·f"<{type(self).__name__}·query={self._expr!r}·data={data}>"
1008 ===============================================================================1008 ===============================================================================
1009 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.1009 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
1010 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.1010 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.25 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/contracts/default.html
    
Offset 294, 15 lines modifiedOffset 294, 15 lines modified
294 ··········</div>294 ··········</div>
295 ··········<footer>295 ··········<footer>
  
296 ··<hr/>296 ··<hr/>
  
297 ··<div·role="contentinfo">297 ··<div·role="contentinfo">
298 ····<p>&#169;·Copyright·Scrapy·developers.298 ····<p>&#169;·Copyright·Scrapy·developers.
299 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.299 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
300 ······</span></p>300 ······</span></p>
301 ··</div>301 ··</div>
  
302 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a302 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
303 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>303 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
304 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.304 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
305 ···305 ···
⊟
607 B
html2text {}
    
Offset 205, 9 lines modifiedOffset 205, 9 lines modified
205 ················missing·=·[arg·for·arg·in·self.args·if·arg·not·in·ItemAdapter205 ················missing·=·[arg·for·arg·in·self.args·if·arg·not·in·ItemAdapter
206 (x)]206 (x)]
207 ················if·missing:207 ················if·missing:
208 ····················missing_fields·=·",·".join(missing)208 ····················missing_fields·=·",·".join(missing)
209 ····················raise·ContractFail(f"Missing·fields:·{missing_fields}")209 ····················raise·ContractFail(f"Missing·fields:·{missing_fields}")
  
210 ===============================================================================210 ===============================================================================
211 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.211 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
212 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.212 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.21 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/contracts.html
    
Offset 364, 15 lines modifiedOffset 364, 15 lines modified
364 ··········</div>364 ··········</div>
365 ··········<footer>365 ··········<footer>
  
366 ··<hr/>366 ··<hr/>
  
367 ··<div·role="contentinfo">367 ··<div·role="contentinfo">
368 ····<p>&#169;·Copyright·Scrapy·developers.368 ····<p>&#169;·Copyright·Scrapy·developers.
369 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.369 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
370 ······</span></p>370 ······</span></p>
371 ··</div>371 ··</div>
  
372 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a372 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
373 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>373 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
374 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.374 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
375 ···375 ···
⊟
583 B
html2text {}
    
Offset 278, 9 lines modifiedOffset 278, 9 lines modified
278 ········def·__str__(_self)·->·str:278 ········def·__str__(_self)·->·str:
279 ············return·f"[{spider}]·{method.__name__}·({desc})"279 ············return·f"[{spider}]·{method.__name__}·({desc})"
  
280 ····name·=·f"{spider}_{method.__name__}"280 ····name·=·f"{spider}_{method.__name__}"
281 ····setattr(ContractTestCase,·name,·lambda·x:·x)281 ····setattr(ContractTestCase,·name,·lambda·x:·x)
282 ····return·ContractTestCase(name)282 ····return·ContractTestCase(name)
283 ===============================================================================283 ===============================================================================
284 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.284 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
285 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.285 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.23 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/core/scheduler.html
    
Offset 571, 15 lines modifiedOffset 571, 15 lines modified
571 ··········</div>571 ··········</div>
572 ··········<footer>572 ··········<footer>
  
573 ··<hr/>573 ··<hr/>
  
574 ··<div·role="contentinfo">574 ··<div·role="contentinfo">
575 ····<p>&#169;·Copyright·Scrapy·developers.575 ····<p>&#169;·Copyright·Scrapy·developers.
576 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.576 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
577 ······</span></p>577 ······</span></p>
578 ··</div>578 ··</div>
  
579 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a579 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
580 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>580 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
581 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.581 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
582 ···582 ···
⊟
590 B
html2text {}
    
Offset 533, 9 lines modifiedOffset 533, 9 lines modified
533 ············return·cast(list[int],·json.load(f))533 ············return·cast(list[int],·json.load(f))
  
534 ····def·_write_dqs_state(self,·dqdir:·str,·state:·list[int])·->·None:534 ····def·_write_dqs_state(self,·dqdir:·str,·state:·list[int])·->·None:
535 ········with·Path(dqdir,·"active.json").open("w",·encoding="utf-8")·as·f:535 ········with·Path(dqdir,·"active.json").open("w",·encoding="utf-8")·as·f:
536 ············json.dump(state,·f)536 ············json.dump(state,·f)
  
537 ===============================================================================537 ===============================================================================
538 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.538 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
539 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.539 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.13 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/crawler.html
    
Offset 705, 15 lines modifiedOffset 705, 15 lines modified
705 ··········</div>705 ··········</div>
706 ··········<footer>706 ··········<footer>
  
707 ··<hr/>707 ··<hr/>
  
708 ··<div·role="contentinfo">708 ··<div·role="contentinfo">
709 ····<p>&#169;·Copyright·Scrapy·developers.709 ····<p>&#169;·Copyright·Scrapy·developers.
710 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.710 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
711 ······</span></p>711 ······</span></p>
712 ··</div>712 ··</div>
  
713 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a713 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
714 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>714 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
715 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.715 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
716 ···716 ···
⊟
501 B
html2text {}
    
Offset 640, 9 lines modifiedOffset 640, 9 lines modified
  
640 ········try:640 ········try:
641 ············reactor.stop()641 ············reactor.stop()
642 ········except·RuntimeError:··#·raised·if·already·stopped·or·in·shutdown·stage642 ········except·RuntimeError:··#·raised·if·already·stopped·or·in·shutdown·stage
643 ············pass643 ············pass
  
644 ===============================================================================644 ===============================================================================
645 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.645 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
646 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.646 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.26 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/ajaxcrawl.html
    
Offset 261, 15 lines modifiedOffset 261, 15 lines modified
261 ··········</div>261 ··········</div>
262 ··········<footer>262 ··········<footer>
  
263 ··<hr/>263 ··<hr/>
  
264 ··<div·role="contentinfo">264 ··<div·role="contentinfo">
265 ····<p>&#169;·Copyright·Scrapy·developers.265 ····<p>&#169;·Copyright·Scrapy·developers.
266 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.266 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
267 ······</span></p>267 ······</span></p>
268 ··</div>268 ··</div>
  
269 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a269 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
270 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>270 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
271 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.271 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
272 ···272 ···
⊟
588 B
html2text {}
    
Offset 171, 9 lines modifiedOffset 171, 9 lines modified
171 ········return·False171 ········return·False
  
172 ····text·=·html.remove_tags_with_content(text,·("script",·"noscript"))172 ····text·=·html.remove_tags_with_content(text,·("script",·"noscript"))
173 ····text·=·html.replace_entities(text)173 ····text·=·html.replace_entities(text)
174 ····text·=·html.remove_comments(text)174 ····text·=·html.remove_comments(text)
175 ····return·_ajax_crawlable_re.search(text)·is·not·None175 ····return·_ajax_crawlable_re.search(text)·is·not·None
176 ===============================================================================176 ===============================================================================
177 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.177 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
178 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.178 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.25 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/cookies.html
    
Offset 336, 15 lines modifiedOffset 336, 15 lines modified
336 ··········</div>336 ··········</div>
337 ··········<footer>337 ··········<footer>
  
338 ··<hr/>338 ··<hr/>
  
339 ··<div·role="contentinfo">339 ··<div·role="contentinfo">
340 ····<p>&#169;·Copyright·Scrapy·developers.340 ····<p>&#169;·Copyright·Scrapy·developers.
341 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.341 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
342 ······</span></p>342 ······</span></p>
343 ··</div>343 ··</div>
  
344 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a344 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
345 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>345 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
346 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.346 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
347 ···347 ···
⊟
585 B
html2text {}
    
Offset 252, 9 lines modifiedOffset 252, 9 lines modified
252 "https")252 "https")
253 ········formatted·=·filter(None,·(self._format_cookie(c,·request)·for·c·in253 ········formatted·=·filter(None,·(self._format_cookie(c,·request)·for·c·in
254 cookies))254 cookies))
255 ········response·=·Response(request.url,·headers={"Set-Cookie":·formatted})255 ········response·=·Response(request.url,·headers={"Set-Cookie":·formatted})
256 ········return·jar.make_cookies(response,·request)256 ········return·jar.make_cookies(response,·request)
  
257 ===============================================================================257 ===============================================================================
258 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.258 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
259 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.259 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.23 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/defaultheaders.html
    
Offset 192, 15 lines modifiedOffset 192, 15 lines modified
192 ··········</div>192 ··········</div>
193 ··········<footer>193 ··········<footer>
  
194 ··<hr/>194 ··<hr/>
  
195 ··<div·role="contentinfo">195 ··<div·role="contentinfo">
196 ····<p>&#169;·Copyright·Scrapy·developers.196 ····<p>&#169;·Copyright·Scrapy·developers.
197 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.197 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
198 ······</span></p>198 ······</span></p>
199 ··</div>199 ··</div>
  
200 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a200 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
201 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>201 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
202 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.202 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
203 ···203 ···
⊟
545 B
html2text {}
    
Offset 98, 9 lines modifiedOffset 98, 9 lines modified
98 ········self,·request:·Request,·spider:·Spider98 ········self,·request:·Request,·spider:·Spider
99 ····)·->·Request·|·Response·|·None:99 ····)·->·Request·|·Response·|·None:
100 ········for·k,·v·in·self._headers:100 ········for·k,·v·in·self._headers:
101 ············request.headers.setdefault(k,·v)101 ············request.headers.setdefault(k,·v)
102 ········return·None102 ········return·None
  
103 ===============================================================================103 ===============================================================================
104 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.104 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
105 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.105 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.25 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/downloadtimeout.html
    
Offset 193, 15 lines modifiedOffset 193, 15 lines modified
193 ··········</div>193 ··········</div>
194 ··········<footer>194 ··········<footer>
  
195 ··<hr/>195 ··<hr/>
  
196 ··<div·role="contentinfo">196 ··<div·role="contentinfo">
197 ····<p>&#169;·Copyright·Scrapy·developers.197 ····<p>&#169;·Copyright·Scrapy·developers.
198 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.198 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
199 ······</span></p>199 ······</span></p>
200 ··</div>200 ··</div>
  
201 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a201 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
202 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>202 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
203 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.203 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
204 ···204 ···
⊟
562 B
html2text {}
    
Offset 98, 9 lines modifiedOffset 98, 9 lines modified
98 ········self,·request:·Request,·spider:·Spider98 ········self,·request:·Request,·spider:·Spider
99 ····)·->·Request·|·Response·|·None:99 ····)·->·Request·|·Response·|·None:
100 ········if·self._timeout:100 ········if·self._timeout:
101 ············request.meta.setdefault("download_timeout",·self._timeout)101 ············request.meta.setdefault("download_timeout",·self._timeout)
102 ········return·None102 ········return·None
  
103 ===============================================================================103 ===============================================================================
104 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.104 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
105 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.105 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.26 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/httpauth.html
    
Offset 202, 15 lines modifiedOffset 202, 15 lines modified
202 ··········</div>202 ··········</div>
203 ··········<footer>203 ··········<footer>
  
204 ··<hr/>204 ··<hr/>
  
205 ··<div·role="contentinfo">205 ··<div·role="contentinfo">
206 ····<p>&#169;·Copyright·Scrapy·developers.206 ····<p>&#169;·Copyright·Scrapy·developers.
207 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.207 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
208 ······</span></p>208 ······</span></p>
209 ··</div>209 ··</div>
  
210 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a210 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
211 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>211 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
212 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.212 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
213 ···213 ···
⊟
588 B
html2text {}
    
Offset 108, 9 lines modifiedOffset 108, 9 lines modified
108 ········if·auth·and·b"Authorization"·not·in·request.headers:108 ········if·auth·and·b"Authorization"·not·in·request.headers:
109 ············if·not·self.domain·or·url_is_from_any_domain(request.url,109 ············if·not·self.domain·or·url_is_from_any_domain(request.url,
110 [self.domain]):110 [self.domain]):
111 ················request.headers[b"Authorization"]·=·auth111 ················request.headers[b"Authorization"]·=·auth
112 ········return·None112 ········return·None
  
113 ===============================================================================113 ===============================================================================
114 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.114 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
115 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.115 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.32 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/httpcache.html
    
Offset 311, 15 lines modifiedOffset 311, 15 lines modified
311 ··········</div>311 ··········</div>
312 ··········<footer>312 ··········<footer>
  
313 ··<hr/>313 ··<hr/>
  
314 ··<div·role="contentinfo">314 ··<div·role="contentinfo">
315 ····<p>&#169;·Copyright·Scrapy·developers.315 ····<p>&#169;·Copyright·Scrapy·developers.
316 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.316 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
317 ······</span></p>317 ······</span></p>
318 ··</div>318 ··</div>
  
319 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a319 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
320 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>320 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
321 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.321 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
322 ···322 ···
⊟
650 B
html2text {}
    
Offset 219, 9 lines modifiedOffset 219, 9 lines modified
219 ········if·self.policy.should_cache_response(response,·request):219 ········if·self.policy.should_cache_response(response,·request):
220 ············self.stats.inc_value("httpcache/store",·spider=spider)220 ············self.stats.inc_value("httpcache/store",·spider=spider)
221 ············self.storage.store_response(spider,·request,·response)221 ············self.storage.store_response(spider,·request,·response)
222 ········else:222 ········else:
223 ············self.stats.inc_value("httpcache/uncacheable",·spider=spider)223 ············self.stats.inc_value("httpcache/uncacheable",·spider=spider)
  
224 ===============================================================================224 ===============================================================================
225 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.225 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
226 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.226 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.3 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/httpcompression.html
    
Offset 327, 15 lines modifiedOffset 327, 15 lines modified
327 ··········</div>327 ··········</div>
328 ··········<footer>328 ··········<footer>
  
329 ··<hr/>329 ··<hr/>
  
330 ··<div·role="contentinfo">330 ··<div·role="contentinfo">
331 ····<p>&#169;·Copyright·Scrapy·developers.331 ····<p>&#169;·Copyright·Scrapy·developers.
332 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.332 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
333 ······</span></p>333 ······</span></p>
334 ··</div>334 ··</div>
  
335 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a335 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
336 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>336 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
337 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.337 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
338 ···338 ···
⊟
618 B
html2text {}
    
Offset 235, 9 lines modifiedOffset 235, 9 lines modified
235 ········if·encoding·==·b"br"·and·b"br"·in·ACCEPTED_ENCODINGS:235 ········if·encoding·==·b"br"·and·b"br"·in·ACCEPTED_ENCODINGS:
236 ············return·_unbrotli(body,·max_size=max_size)236 ············return·_unbrotli(body,·max_size=max_size)
237 ········if·encoding·==·b"zstd"·and·b"zstd"·in·ACCEPTED_ENCODINGS:237 ········if·encoding·==·b"zstd"·and·b"zstd"·in·ACCEPTED_ENCODINGS:
238 ············return·_unzstd(body,·max_size=max_size)238 ············return·_unzstd(body,·max_size=max_size)
239 ········return·body239 ········return·body
  
240 ===============================================================================240 ===============================================================================
241 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.241 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
242 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.242 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.25 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/httpproxy.html
    
Offset 261, 15 lines modifiedOffset 261, 15 lines modified
261 ··········</div>261 ··········</div>
262 ··········<footer>262 ··········<footer>
  
263 ··<hr/>263 ··<hr/>
  
264 ··<div·role="contentinfo">264 ··<div·role="contentinfo">
265 ····<p>&#169;·Copyright·Scrapy·developers.265 ····<p>&#169;·Copyright·Scrapy·developers.
266 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.266 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
267 ······</span></p>267 ······</span></p>
268 ··</div>268 ··</div>
  
269 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a269 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
270 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>270 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
271 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.271 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
272 ···272 ···
⊟
580 B
html2text {}
    
Offset 169, 9 lines modifiedOffset 169, 9 lines modified
169 ········elif·b"Proxy-Authorization"·in·request.headers:169 ········elif·b"Proxy-Authorization"·in·request.headers:
170 ············if·proxy_url:170 ············if·proxy_url:
171 ················request.meta["_auth_proxy"]·=·proxy_url171 ················request.meta["_auth_proxy"]·=·proxy_url
172 ············else:172 ············else:
173 ················del·request.headers[b"Proxy-Authorization"]173 ················del·request.headers[b"Proxy-Authorization"]
  
174 ===============================================================================174 ===============================================================================
175 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.175 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
176 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.176 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.22 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/offsite.html
    
Offset 243, 15 lines modifiedOffset 243, 15 lines modified
243 ··········</div>243 ··········</div>
244 ··········<footer>244 ··········<footer>
  
245 ··<hr/>245 ··<hr/>
  
246 ··<div·role="contentinfo">246 ··<div·role="contentinfo">
247 ····<p>&#169;·Copyright·Scrapy·developers.247 ····<p>&#169;·Copyright·Scrapy·developers.
248 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.248 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
249 ······</span></p>249 ······</span></p>
250 ··</div>250 ··</div>
  
251 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a251 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
252 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>252 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
253 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.253 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
254 ···254 ···
⊟
555 B
html2text {}
    
Offset 149, 9 lines modifiedOffset 149, 9 lines modified
149 ················warnings.warn(message)149 ················warnings.warn(message)
150 ············else:150 ············else:
151 ················domains.append(re.escape(domain))151 ················domains.append(re.escape(domain))
152 ········regex·=·rf'^(.*\.)?({"|".join(domains)})$'152 ········regex·=·rf'^(.*\.)?({"|".join(domains)})$'
153 ········return·re.compile(regex)153 ········return·re.compile(regex)
  
154 ===============================================================================154 ===============================================================================
155 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.155 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
156 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.156 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.29 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/redirect.html
    
Offset 362, 15 lines modifiedOffset 362, 15 lines modified
362 ··········</div>362 ··········</div>
363 ··········<footer>363 ··········<footer>
  
364 ··<hr/>364 ··<hr/>
  
365 ··<div·role="contentinfo">365 ··<div·role="contentinfo">
366 ····<p>&#169;·Copyright·Scrapy·developers.366 ····<p>&#169;·Copyright·Scrapy·developers.
367 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.367 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
368 ······</span></p>368 ······</span></p>
369 ··</div>369 ··</div>
  
370 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a370 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
371 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>371 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
372 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.372 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
373 ···373 ···
⊟
618 B
html2text {}
    
Offset 276, 9 lines modifiedOffset 276, 9 lines modified
276 ········if·urlparse_cached(redirected).scheme·not·in·{"http",·"https"}:276 ········if·urlparse_cached(redirected).scheme·not·in·{"http",·"https"}:
277 ············return·response277 ············return·response
278 ········if·cast(float,·interval)·<·self._maxdelay:278 ········if·cast(float,·interval)·<·self._maxdelay:
279 ············return·self._redirect(redirected,·request,·spider,·"meta·refresh")279 ············return·self._redirect(redirected,·request,·spider,·"meta·refresh")
280 ········return·response280 ········return·response
  
281 ===============================================================================281 ===============================================================================
282 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.282 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
283 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.283 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.18 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/retry.html
    
Offset 331, 15 lines modifiedOffset 331, 15 lines modified
331 ··········</div>331 ··········</div>
332 ··········<footer>332 ··········<footer>
  
333 ··<hr/>333 ··<hr/>
  
334 ··<div·role="contentinfo">334 ··<div·role="contentinfo">
335 ····<p>&#169;·Copyright·Scrapy·developers.335 ····<p>&#169;·Copyright·Scrapy·developers.
336 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.336 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
337 ······</span></p>337 ······</span></p>
338 ··</div>338 ··</div>
  
339 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a339 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
340 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>340 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
341 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.341 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
342 ···342 ···
⊟
518 B
html2text {}
    
Offset 243, 9 lines modifiedOffset 243, 9 lines modified
243 ············reason=reason,243 ············reason=reason,
244 ············spider=spider,244 ············spider=spider,
245 ············max_retry_times=max_retry_times,245 ············max_retry_times=max_retry_times,
246 ············priority_adjust=priority_adjust,246 ············priority_adjust=priority_adjust,
247 ········)247 ········)
  
248 ===============================================================================248 ===============================================================================
249 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.249 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
250 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.250 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.23 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/robotstxt.html
    
Offset 312, 15 lines modifiedOffset 312, 15 lines modified
312 ··········</div>312 ··········</div>
313 ··········<footer>313 ··········<footer>
  
314 ··<hr/>314 ··<hr/>
  
315 ··<div·role="contentinfo">315 ··<div·role="contentinfo">
316 ····<p>&#169;·Copyright·Scrapy·developers.316 ····<p>&#169;·Copyright·Scrapy·developers.
317 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.317 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
318 ······</span></p>318 ······</span></p>
319 ··</div>319 ··</div>
  
320 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a320 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
321 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>321 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
322 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.322 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
323 ···323 ···
⊟
560 B
html2text {}
    
Offset 224, 9 lines modifiedOffset 224, 9 lines modified
224 ············self.crawler.stats.inc_value(key)224 ············self.crawler.stats.inc_value(key)
225 ········rp_dfd·=·self._parsers[netloc]225 ········rp_dfd·=·self._parsers[netloc]
226 ········assert·isinstance(rp_dfd,·Deferred)226 ········assert·isinstance(rp_dfd,·Deferred)
227 ········self._parsers[netloc]·=·None227 ········self._parsers[netloc]·=·None
228 ········rp_dfd.callback(None)228 ········rp_dfd.callback(None)
  
229 ===============================================================================229 ===============================================================================
230 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.230 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
231 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.231 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.24 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/stats.html
    
Offset 238, 15 lines modifiedOffset 238, 15 lines modified
238 ··········</div>238 ··········</div>
239 ··········<footer>239 ··········<footer>
  
240 ··<hr/>240 ··<hr/>
  
241 ··<div·role="contentinfo">241 ··<div·role="contentinfo">
242 ····<p>&#169;·Copyright·Scrapy·developers.242 ····<p>&#169;·Copyright·Scrapy·developers.
243 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.243 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
244 ······</span></p>244 ······</span></p>
245 ··</div>245 ··</div>
  
246 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a246 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
247 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>247 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
248 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.248 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
249 ···249 ···
⊟
571 B
html2text {}
    
Offset 145, 9 lines modifiedOffset 145, 9 lines modified
145 ········self.stats.inc_value("downloader/exception_count",·spider=spider)145 ········self.stats.inc_value("downloader/exception_count",·spider=spider)
146 ········self.stats.inc_value(146 ········self.stats.inc_value(
147 ············f"downloader/exception_type_count/{ex_class}",·spider=spider147 ············f"downloader/exception_type_count/{ex_class}",·spider=spider
148 ········)148 ········)
149 ········return·None149 ········return·None
  
150 ===============================================================================150 ===============================================================================
151 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.151 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
152 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.152 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.24 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/downloadermiddlewares/useragent.html
    
Offset 191, 15 lines modifiedOffset 191, 15 lines modified
191 ··········</div>191 ··········</div>
192 ··········<footer>192 ··········<footer>
  
193 ··<hr/>193 ··<hr/>
  
194 ··<div·role="contentinfo">194 ··<div·role="contentinfo">
195 ····<p>&#169;·Copyright·Scrapy·developers.195 ····<p>&#169;·Copyright·Scrapy·developers.
196 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.196 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
197 ······</span></p>197 ······</span></p>
198 ··</div>198 ··</div>
  
199 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a199 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
200 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>200 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
201 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.201 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
202 ···202 ···
⊟
564 B
html2text {}
    
Offset 96, 9 lines modifiedOffset 96, 9 lines modified
96 ········self,·request:·Request,·spider:·Spider96 ········self,·request:·Request,·spider:·Spider
97 ····)·->·Request·|·Response·|·None:97 ····)·->·Request·|·Response·|·None:
98 ········if·self.user_agent:98 ········if·self.user_agent:
99 ············request.headers.setdefault(b"User-Agent",·self.user_agent)99 ············request.headers.setdefault(b"User-Agent",·self.user_agent)
100 ········return·None100 ········return·None
  
101 ===============================================================================101 ===============================================================================
102 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.102 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
103 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.103 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.12 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/exceptions.html
    
Offset 273, 15 lines modifiedOffset 273, 15 lines modified
273 ··········</div>273 ··········</div>
274 ··········<footer>274 ··········<footer>
  
275 ··<hr/>275 ··<hr/>
  
276 ··<div·role="contentinfo">276 ··<div·role="contentinfo">
277 ····<p>&#169;·Copyright·Scrapy·developers.277 ····<p>&#169;·Copyright·Scrapy·developers.
278 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.278 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
279 ······</span></p>279 ······</span></p>
280 ··</div>280 ··</div>
  
281 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a281 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
282 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>282 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
283 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.283 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
284 ···284 ···
⊟
482 B
html2text {}
    
Offset 188, 9 lines modifiedOffset 188, 9 lines modified
188 _\x8[_\x8d_\x8o_\x8c_\x8s_\x8]188 _\x8[_\x8d_\x8o_\x8c_\x8s_\x8]
189 class·ContractFail(AssertionError):189 class·ContractFail(AssertionError):
190 ····"""Error·raised·in·case·of·a·failing·contract"""190 ····"""Error·raised·in·case·of·a·failing·contract"""
  
191 ····pass191 ····pass
  
192 ===============================================================================192 ===============================================================================
193 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.193 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
194 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.194 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.19 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/exporters.html
    
Offset 565, 15 lines modifiedOffset 565, 15 lines modified
565 ··········</div>565 ··········</div>
566 ··········<footer>566 ··········<footer>
  
567 ··<hr/>567 ··<hr/>
  
568 ··<div·role="contentinfo">568 ··<div·role="contentinfo">
569 ····<p>&#169;·Copyright·Scrapy·developers.569 ····<p>&#169;·Copyright·Scrapy·developers.
570 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.570 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
571 ······</span></p>571 ······</span></p>
572 ··</div>572 ··</div>
  
573 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a573 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
574 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>574 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
575 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.575 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
576 ···576 ···
⊟
559 B
html2text {}
    
Offset 499, 9 lines modifiedOffset 499, 9 lines modified
499 ····def·export_item(self,·item:·Any)·->·dict[str·|·bytes,·Any]:··#·type:·ignore499 ····def·export_item(self,·item:·Any)·->·dict[str·|·bytes,·Any]:··#·type:·ignore
500 [override]500 [override]
501 ········result:·dict[str·|·bytes,·Any]·=·dict(self._get_serialized_fields501 ········result:·dict[str·|·bytes,·Any]·=·dict(self._get_serialized_fields
502 (item))502 (item))
503 ········return·result503 ········return·result
  
504 ===============================================================================504 ===============================================================================
505 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.505 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
506 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.506 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.21 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/closespider.html
    
Offset 297, 15 lines modifiedOffset 297, 15 lines modified
297 ··········</div>297 ··········</div>
298 ··········<footer>298 ··········<footer>
  
299 ··<hr/>299 ··<hr/>
  
300 ··<div·role="contentinfo">300 ··<div·role="contentinfo">
301 ····<p>&#169;·Copyright·Scrapy·developers.301 ····<p>&#169;·Copyright·Scrapy·developers.
302 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.302 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
303 ······</span></p>303 ······</span></p>
304 ··</div>304 ··</div>
  
305 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a305 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
306 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>306 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
307 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.307 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
308 ···308 ···
⊟
552 B
html2text {}
    
Offset 215, 9 lines modifiedOffset 215, 9 lines modified
215 ················f"{self.timeout_no_item}·seconds."215 ················f"{self.timeout_no_item}·seconds."
216 ············)216 ············)
217 ············assert·self.crawler.engine217 ············assert·self.crawler.engine
218 ············self.crawler.engine.close_spider(spider,218 ············self.crawler.engine.close_spider(spider,
219 "closespider_timeout_no_item")219 "closespider_timeout_no_item")
  
220 ===============================================================================220 ===============================================================================
221 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.221 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
222 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.222 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.22 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/corestats.html
    
Offset 214, 15 lines modifiedOffset 214, 15 lines modified
214 ··········</div>214 ··········</div>
215 ··········<footer>215 ··········<footer>
  
216 ··<hr/>216 ··<hr/>
  
217 ··<div·role="contentinfo">217 ··<div·role="contentinfo">
218 ····<p>&#169;·Copyright·Scrapy·developers.218 ····<p>&#169;·Copyright·Scrapy·developers.
219 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.219 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
220 ······</span></p>220 ······</span></p>
221 ··</div>221 ··</div>
  
222 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a222 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
223 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>223 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
224 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.224 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
225 ···225 ···
⊟
569 B
html2text {}
    
Offset 122, 9 lines modifiedOffset 122, 9 lines modified
122 ->·None:122 ->·None:
123 ········reason·=·exception.__class__.__name__123 ········reason·=·exception.__class__.__name__
124 ········self.stats.inc_value("item_dropped_count",·spider=spider)124 ········self.stats.inc_value("item_dropped_count",·spider=spider)
125 ········self.stats.inc_value(f"item_dropped_reasons_count/{reason}",125 ········self.stats.inc_value(f"item_dropped_reasons_count/{reason}",
126 spider=spider)126 spider=spider)
  
127 ===============================================================================127 ===============================================================================
128 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.128 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
129 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.129 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.34 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/feedexport.html
    
Offset 883, 15 lines modifiedOffset 883, 15 lines modified
883 ··········</div>883 ··········</div>
884 ··········<footer>884 ··········<footer>
  
885 ··<hr/>885 ··<hr/>
  
886 ··<div·role="contentinfo">886 ··<div·role="contentinfo">
887 ····<p>&#169;·Copyright·Scrapy·developers.887 ····<p>&#169;·Copyright·Scrapy·developers.
888 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.888 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
889 ······</span></p>889 ······</span></p>
890 ··</div>890 ··</div>
  
891 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a891 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
892 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>892 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
893 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.893 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
894 ···894 ···
⊟
685 B
html2text {}
    
Offset 826, 9 lines modifiedOffset 826, 9 lines modified
826 ····def·_load_filter(self,·feed_options:·dict[str,·Any])·->·ItemFilter:826 ····def·_load_filter(self,·feed_options:·dict[str,·Any])·->·ItemFilter:
827 ········#·load·the·item·filter·if·declared·else·load·the·default·filter·class827 ········#·load·the·item·filter·if·declared·else·load·the·default·filter·class
828 ········item_filter_class:·type[ItemFilter]·=·load_object(828 ········item_filter_class:·type[ItemFilter]·=·load_object(
829 ············feed_options.get("item_filter",·ItemFilter)829 ············feed_options.get("item_filter",·ItemFilter)
830 ········)830 ········)
831 ········return·item_filter_class(feed_options)831 ········return·item_filter_class(feed_options)
832 ===============================================================================832 ===============================================================================
833 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.833 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
834 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.834 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.23 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/httpcache.html
    
Offset 586, 15 lines modifiedOffset 586, 15 lines modified
586 ··········</div>586 ··········</div>
587 ··········<footer>587 ··········<footer>
  
588 ··<hr/>588 ··<hr/>
  
589 ··<div·role="contentinfo">589 ··<div·role="contentinfo">
590 ····<p>&#169;·Copyright·Scrapy·developers.590 ····<p>&#169;·Copyright·Scrapy·developers.
591 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.591 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
592 ······</span></p>592 ······</span></p>
593 ··</div>593 ··</div>
  
594 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a594 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
595 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>595 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
596 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.596 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
597 ···597 ···
⊟
574 B
html2text {}
    
Offset 518, 9 lines modifiedOffset 518, 9 lines modified
518 ····try:518 ····try:
519 ········date_str·=·to_unicode(date_str,·encoding="ascii")··#·type:·ignore[arg-519 ········date_str·=·to_unicode(date_str,·encoding="ascii")··#·type:·ignore[arg-
520 type]520 type]
521 ········return·mktime_tz(parsedate_tz(date_str))··#·type:·ignore[arg-type]521 ········return·mktime_tz(parsedate_tz(date_str))··#·type:·ignore[arg-type]
522 ····except·Exception:522 ····except·Exception:
523 ········return·None523 ········return·None
524 ===============================================================================524 ===============================================================================
525 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.525 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
526 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.526 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.21 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/logstats.html
    
Offset 250, 15 lines modifiedOffset 250, 15 lines modified
250 ··········</div>250 ··········</div>
251 ··········<footer>251 ··········<footer>
  
252 ··<hr/>252 ··<hr/>
  
253 ··<div·role="contentinfo">253 ··<div·role="contentinfo">
254 ····<p>&#169;·Copyright·Scrapy·developers.254 ····<p>&#169;·Copyright·Scrapy·developers.
255 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.255 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
256 ······</span></p>256 ······</span></p>
257 ··</div>257 ··</div>
  
258 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a258 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
259 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>259 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
260 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.260 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
261 ···261 ···
⊟
557 B
html2text {}
    
Offset 155, 9 lines modifiedOffset 155, 9 lines modified
  
155 ········items·=·self.stats.get_value("item_scraped_count",·0)155 ········items·=·self.stats.get_value("item_scraped_count",·0)
156 ········pages·=·self.stats.get_value("response_received_count",·0)156 ········pages·=·self.stats.get_value("response_received_count",·0)
  
157 ········return·(pages·/·mins_elapsed),·(items·/·mins_elapsed)157 ········return·(pages·/·mins_elapsed),·(items·/·mins_elapsed)
  
158 ===============================================================================158 ===============================================================================
159 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.159 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
160 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.160 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.19 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/memdebug.html
    
Offset 201, 15 lines modifiedOffset 201, 15 lines modified
201 ··········</div>201 ··········</div>
202 ··········<footer>202 ··········<footer>
  
203 ··<hr/>203 ··<hr/>
  
204 ··<div·role="contentinfo">204 ··<div·role="contentinfo">
205 ····<p>&#169;·Copyright·Scrapy·developers.205 ····<p>&#169;·Copyright·Scrapy·developers.
206 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.206 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
207 ······</span></p>207 ······</span></p>
208 ··</div>208 ··</div>
  
209 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a209 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
210 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>210 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
211 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.211 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
212 ···212 ···
⊟
543 B
html2text {}
    
Offset 106, 9 lines modifiedOffset 106, 9 lines modified
106 ············if·not·wdict:106 ············if·not·wdict:
107 ················continue107 ················continue
108 ············self.stats.set_value(108 ············self.stats.set_value(
109 ················f"memdebug/live_refs/{cls.__name__}",·len(wdict),·spider=spider109 ················f"memdebug/live_refs/{cls.__name__}",·len(wdict),·spider=spider
110 ············)110 ············)
  
111 ===============================================================================111 ===============================================================================
112 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.112 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
113 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.113 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.17 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/memusage.html
    
Offset 313, 15 lines modifiedOffset 313, 15 lines modified
313 ··········</div>313 ··········</div>
314 ··········<footer>314 ··········<footer>
  
315 ··<hr/>315 ··<hr/>
  
316 ··<div·role="contentinfo">316 ··<div·role="contentinfo">
317 ····<p>&#169;·Copyright·Scrapy·developers.317 ····<p>&#169;·Copyright·Scrapy·developers.
318 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.318 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
319 ······</span></p>319 ······</span></p>
320 ··</div>320 ··</div>
  
321 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a321 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
322 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>322 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
323 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.323 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
324 ···324 ···
⊟
517 B
html2text {}
    
Offset 230, 9 lines modifiedOffset 230, 9 lines modified
230 ········)230 ········)
231 ········s·+=·"\r\n"231 ········s·+=·"\r\n"
232 ········s·+=·pformat(get_engine_status(self.crawler.engine))232 ········s·+=·pformat(get_engine_status(self.crawler.engine))
233 ········s·+=·"\r\n"233 ········s·+=·"\r\n"
234 ········self.mail.send(rcpts,·subject,·s)234 ········self.mail.send(rcpts,·subject,·s)
  
235 ===============================================================================235 ===============================================================================
236 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.236 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
237 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.237 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.18 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/periodic_log.html
    
Offset 315, 15 lines modifiedOffset 315, 15 lines modified
315 ··········</div>315 ··········</div>
316 ··········<footer>316 ··········<footer>
  
317 ··<hr/>317 ··<hr/>
  
318 ··<div·role="contentinfo">318 ··<div·role="contentinfo">
319 ····<p>&#169;·Copyright·Scrapy·developers.319 ····<p>&#169;·Copyright·Scrapy·developers.
320 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.320 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
321 ······</span></p>321 ······</span></p>
322 ··</div>322 ··</div>
  
323 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a323 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
324 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>324 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
325 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.325 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
326 ···326 ···
⊟
523 B
html2text {}
    
Offset 223, 9 lines modifiedOffset 223, 9 lines modified
  
223 ····def·spider_closed(self,·spider:·Spider,·reason:·str)·->·None:223 ····def·spider_closed(self,·spider:·Spider,·reason:·str)·->·None:
224 ········self.log()224 ········self.log()
225 ········if·self.task·and·self.task.running:225 ········if·self.task·and·self.task.running:
226 ············self.task.stop()226 ············self.task.stop()
  
227 ===============================================================================227 ===============================================================================
228 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.228 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
229 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.229 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.2 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/postprocessing.html
    
Offset 327, 15 lines modifiedOffset 327, 15 lines modified
327 ··········</div>327 ··········</div>
328 ··········<footer>328 ··········<footer>
  
329 ··<hr/>329 ··<hr/>
  
330 ··<div·role="contentinfo">330 ··<div·role="contentinfo">
331 ····<p>&#169;·Copyright·Scrapy·developers.331 ····<p>&#169;·Copyright·Scrapy·developers.
332 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.332 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
333 ······</span></p>333 ······</span></p>
334 ··</div>334 ··</div>
  
335 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a335 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
336 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>336 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
337 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.337 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
338 ···338 ···
⊟
541 B
html2text {}
    
Offset 240, 9 lines modifiedOffset 240, 9 lines modified
  
240 ····def·_get_head_plugin(self)·->·Any:240 ····def·_get_head_plugin(self)·->·Any:
241 ········prev·=·self.file241 ········prev·=·self.file
242 ········for·plugin·in·self.plugins[::-1]:242 ········for·plugin·in·self.plugins[::-1]:
243 ············prev·=·plugin(prev,·self.feed_options)243 ············prev·=·plugin(prev,·self.feed_options)
244 ········return·prev244 ········return·prev
245 ===============================================================================245 ===============================================================================
246 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.246 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
247 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.247 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.15 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/spiderstate.html
    
Offset 205, 15 lines modifiedOffset 205, 15 lines modified
205 ··········</div>205 ··········</div>
206 ··········<footer>206 ··········<footer>
  
207 ··<hr/>207 ··<hr/>
  
208 ··<div·role="contentinfo">208 ··<div·role="contentinfo">
209 ····<p>&#169;·Copyright·Scrapy·developers.209 ····<p>&#169;·Copyright·Scrapy·developers.
210 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.210 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
211 ······</span></p>211 ······</span></p>
212 ··</div>212 ··</div>
  
213 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a213 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
214 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>214 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
215 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.215 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
216 ···216 ···
⊟
490 B
html2text {}
    
Offset 113, 9 lines modifiedOffset 113, 9 lines modified
  
113 ····@property113 ····@property
114 ····def·statefn(self)·->·str:114 ····def·statefn(self)·->·str:
115 ········assert·self.jobdir115 ········assert·self.jobdir
116 ········return·str(Path(self.jobdir,·"spider.state"))116 ········return·str(Path(self.jobdir,·"spider.state"))
  
117 ===============================================================================117 ===============================================================================
118 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.118 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
119 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.119 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.24 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/statsmailer.html
    
Offset 202, 15 lines modifiedOffset 202, 15 lines modified
202 ··········</div>202 ··········</div>
203 ··········<footer>203 ··········<footer>
  
204 ··<hr/>204 ··<hr/>
  
205 ··<div·role="contentinfo">205 ··<div·role="contentinfo">
206 ····<p>&#169;·Copyright·Scrapy·developers.206 ····<p>&#169;·Copyright·Scrapy·developers.
207 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.207 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
208 ······</span></p>208 ······</span></p>
209 ··</div>209 ··</div>
  
210 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a210 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
211 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>211 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
212 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.212 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
213 ···213 ···
⊟
589 B
html2text {}
    
Offset 110, 9 lines modifiedOffset 110, 9 lines modified
110 ().items())110 ().items())
111 ········body·+=·f"\n\n{spider.name}·stats\n\n"111 ········body·+=·f"\n\n{spider.name}·stats\n\n"
112 ········body·+=·"\n".join(f"{k:<50}·:·{v}"·for·k,·v·in·spider_stats.items())112 ········body·+=·"\n".join(f"{k:<50}·:·{v}"·for·k,·v·in·spider_stats.items())
113 ········return·self.mail.send(self.recipients,·f"Scrapy·stats·for:113 ········return·self.mail.send(self.recipients,·f"Scrapy·stats·for:
114 {spider.name}",·body)114 {spider.name}",·body)
  
115 ===============================================================================115 ===============================================================================
116 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.116 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
117 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.117 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.21 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/extensions/telnet.html
    
Offset 273, 15 lines modifiedOffset 273, 15 lines modified
273 ··········</div>273 ··········</div>
274 ··········<footer>274 ··········<footer>
  
275 ··<hr/>275 ··<hr/>
  
276 ··<div·role="contentinfo">276 ··<div·role="contentinfo">
277 ····<p>&#169;·Copyright·Scrapy·developers.277 ····<p>&#169;·Copyright·Scrapy·developers.
278 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.278 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
279 ······</span></p>279 ······</span></p>
280 ··</div>280 ··</div>
  
281 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a281 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
282 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>282 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
283 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.283 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
284 ···284 ···
⊟
565 B
html2text {}
    
Offset 183, 9 lines modifiedOffset 183, 9 lines modified
183 ············"https://docs.scrapy.org/en/latest/topics/telnetconsole.html",183 ············"https://docs.scrapy.org/en/latest/topics/telnetconsole.html",
184 ········}184 ········}
185 ········self.crawler.signals.send_catch_log(update_telnet_vars,185 ········self.crawler.signals.send_catch_log(update_telnet_vars,
186 telnet_vars=telnet_vars)186 telnet_vars=telnet_vars)
187 ········return·telnet_vars187 ········return·telnet_vars
  
188 ===============================================================================188 ===============================================================================
189 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.189 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
190 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.190 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.21 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/http/request/json_request.html
    
Offset 232, 15 lines modifiedOffset 232, 15 lines modified
232 ··········</div>232 ··········</div>
233 ··········<footer>233 ··········<footer>
  
234 ··<hr/>234 ··<hr/>
  
235 ··<div·role="contentinfo">235 ··<div·role="contentinfo">
236 ····<p>&#169;·Copyright·Scrapy·developers.236 ····<p>&#169;·Copyright·Scrapy·developers.
237 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.237 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
238 ······</span></p>238 ······</span></p>
239 ··</div>239 ··</div>
  
240 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a240 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
241 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>241 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
242 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.242 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
243 ···243 ···
⊟
546 B
html2text {}
    
Offset 139, 9 lines modifiedOffset 139, 9 lines modified
139 ········return·super().replace(*args,·cls=cls,·**kwargs)139 ········return·super().replace(*args,·cls=cls,·**kwargs)
  
140 ····def·_dumps(self,·data:·Any)·->·str:140 ····def·_dumps(self,·data:·Any)·->·str:
141 ········"""Convert·to·JSON"""141 ········"""Convert·to·JSON"""
142 ········return·json.dumps(data,·**self._dumps_kwargs)142 ········return·json.dumps(data,·**self._dumps_kwargs)
  
143 ===============================================================================143 ===============================================================================
144 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.144 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
145 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.145 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.29 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/http/request.html
    
Offset 466, 15 lines modifiedOffset 466, 15 lines modified
466 ··········</div>466 ··········</div>
467 ··········<footer>467 ··········<footer>
  
468 ··<hr/>468 ··<hr/>
  
469 ··<div·role="contentinfo">469 ··<div·role="contentinfo">
470 ····<p>&#169;·Copyright·Scrapy·developers.470 ····<p>&#169;·Copyright·Scrapy·developers.
471 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.471 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
472 ······</span></p>472 ······</span></p>
473 ··</div>473 ··</div>
  
474 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a474 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
475 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>475 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
476 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.476 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
477 ···477 ···
⊟
651 B
html2text {}
    
Offset 393, 9 lines modifiedOffset 393, 9 lines modified
393 ············#393 ············#
394 ············#·Reference:·The·standard·type·hierarchy394 ············#·Reference:·The·standard·type·hierarchy
395 ············#·https://docs.python.org/3/reference/datamodel.html395 ············#·https://docs.python.org/3/reference/datamodel.html
396 ············if·obj_func.__func__·is·func.__func__:396 ············if·obj_func.__func__·is·func.__func__:
397 ················return·name397 ················return·name
398 ····raise·ValueError(f"Function·{func}·is·not·an·instance·method·in:·{obj}")398 ····raise·ValueError(f"Function·{func}·is·not·an·instance·method·in:·{obj}")
399 ===============================================================================399 ===============================================================================
400 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.400 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
401 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.401 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.08 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/http/response/html.html
    
Offset 167, 15 lines modifiedOffset 167, 15 lines modified
167 ··········</div>167 ··········</div>
168 ··········<footer>168 ··········<footer>
  
169 ··<hr/>169 ··<hr/>
  
170 ··<div·role="contentinfo">170 ··<div·role="contentinfo">
171 ····<p>&#169;·Copyright·Scrapy·developers.171 ····<p>&#169;·Copyright·Scrapy·developers.
172 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.172 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
173 ······</span></p>173 ······</span></p>
174 ··</div>174 ··</div>
  
175 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a175 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
176 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>176 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
177 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.177 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
178 ···178 ···
⊟
426 B
html2text {}
    
Offset 72, 9 lines modifiedOffset 72, 9 lines modified
  
  
72 _\x8[_\x8d_\x8o_\x8c_\x8s_\x8]72 _\x8[_\x8d_\x8o_\x8c_\x8s_\x8]
73 class·HtmlResponse(TextResponse):73 class·HtmlResponse(TextResponse):
74 ····pass74 ····pass
  
75 ===============================================================================75 ===============================================================================
76 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.76 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
77 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.77 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.08 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/http/response/json.html
    
Offset 167, 15 lines modifiedOffset 167, 15 lines modified
167 ··········</div>167 ··········</div>
168 ··········<footer>168 ··········<footer>
  
169 ··<hr/>169 ··<hr/>
  
170 ··<div·role="contentinfo">170 ··<div·role="contentinfo">
171 ····<p>&#169;·Copyright·Scrapy·developers.171 ····<p>&#169;·Copyright·Scrapy·developers.
172 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.172 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
173 ······</span></p>173 ······</span></p>
174 ··</div>174 ··</div>
  
175 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a175 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
176 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>176 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
177 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.177 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
178 ···178 ···
⊟
426 B
html2text {}
    
Offset 72, 9 lines modifiedOffset 72, 9 lines modified
  
  
72 _\x8[_\x8d_\x8o_\x8c_\x8s_\x8]72 _\x8[_\x8d_\x8o_\x8c_\x8s_\x8]
73 class·JsonResponse(TextResponse):73 class·JsonResponse(TextResponse):
74 ····pass74 ····pass
  
75 ===============================================================================75 ===============================================================================
76 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.76 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
77 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.77 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.2 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/http/response/text.html
    
Offset 492, 15 lines modifiedOffset 492, 15 lines modified
492 ··········</div>492 ··········</div>
493 ··········<footer>493 ··········<footer>
  
494 ··<hr/>494 ··<hr/>
  
495 ··<div·role="contentinfo">495 ··<div·role="contentinfo">
496 ····<p>&#169;·Copyright·Scrapy·developers.496 ····<p>&#169;·Copyright·Scrapy·developers.
497 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.497 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
498 ······</span></p>498 ······</span></p>
499 ··</div>499 ··</div>
  
500 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a500 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
501 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>501 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
502 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.502 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
503 ···503 ···
⊟
555 B
html2text {}
    
Offset 422, 9 lines modifiedOffset 422, 9 lines modified
422 ········)422 ········)
423 ····href·=·sel.root.get("href")423 ····href·=·sel.root.get("href")
424 ····if·href·is·None:424 ····if·href·is·None:
425 ········raise·_InvalidSelector(f"<{sel.root.tag}>·element·has·no·href425 ········raise·_InvalidSelector(f"<{sel.root.tag}>·element·has·no·href
426 attribute:·{sel}")426 attribute:·{sel}")
427 ····return·strip_html5_whitespace(href)427 ····return·strip_html5_whitespace(href)
428 ===============================================================================428 ===============================================================================
429 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.429 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
430 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.430 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.07 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/http/response/xml.html
    
Offset 167, 15 lines modifiedOffset 167, 15 lines modified
167 ··········</div>167 ··········</div>
168 ··········<footer>168 ··········<footer>
  
169 ··<hr/>169 ··<hr/>
  
170 ··<div·role="contentinfo">170 ··<div·role="contentinfo">
171 ····<p>&#169;·Copyright·Scrapy·developers.171 ····<p>&#169;·Copyright·Scrapy·developers.
172 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.172 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
173 ······</span></p>173 ······</span></p>
174 ··</div>174 ··</div>
  
175 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a175 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
176 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>176 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
177 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.177 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
178 ···178 ···
⊟
425 B
html2text {}
    
Offset 72, 9 lines modifiedOffset 72, 9 lines modified
  
  
72 _\x8[_\x8d_\x8o_\x8c_\x8s_\x8]72 _\x8[_\x8d_\x8o_\x8c_\x8s_\x8]
73 class·XmlResponse(TextResponse):73 class·XmlResponse(TextResponse):
74 ····pass74 ····pass
  
75 ===============================================================================75 ===============================================================================
76 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.76 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
77 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.77 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.09 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/http/response.html
    
Offset 453, 15 lines modifiedOffset 453, 15 lines modified
453 ··········</div>453 ··········</div>
454 ··········<footer>454 ··········<footer>
  
455 ··<hr/>455 ··<hr/>
  
456 ··<div·role="contentinfo">456 ··<div·role="contentinfo">
457 ····<p>&#169;·Copyright·Scrapy·developers.457 ····<p>&#169;·Copyright·Scrapy·developers.
458 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.458 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
459 ······</span></p>459 ······</span></p>
460 ··</div>460 ··</div>
  
461 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a461 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
462 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>462 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
463 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.463 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
464 ···464 ···
⊟
446 B
html2text {}
    
Offset 369, 9 lines modifiedOffset 369, 9 lines modified
369 ················flags=flags,369 ················flags=flags,
370 ············)370 ············)
371 ············for·url·in·urls371 ············for·url·in·urls
372 ········)372 ········)
  
  
373 ===============================================================================373 ===============================================================================
374 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.374 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
375 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.375 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.13 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/item.html
    
Offset 298, 15 lines modifiedOffset 298, 15 lines modified
298 ··········</div>298 ··········</div>
299 ··········<footer>299 ··········<footer>
  
300 ··<hr/>300 ··<hr/>
  
301 ··<div·role="contentinfo">301 ··<div·role="contentinfo">
302 ····<p>&#169;·Copyright·Scrapy·developers.302 ····<p>&#169;·Copyright·Scrapy·developers.
303 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.303 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
304 ······</span></p>304 ······</span></p>
305 ··</div>305 ··</div>
  
306 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a306 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
307 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>307 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
308 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.308 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
309 ···309 ···
⊟
506 B
html2text {}
    
Offset 211, 9 lines modifiedOffset 211, 9 lines modified
211 _\x8[_\x8d_\x8o_\x8c_\x8s_\x8]211 _\x8[_\x8d_\x8o_\x8c_\x8s_\x8]
212 ····def·deepcopy(self)·->·Self:212 ····def·deepcopy(self)·->·Self:
213 ········"""Return·a·:func:`~copy.deepcopy`·of·this·item."""213 ········"""Return·a·:func:`~copy.deepcopy`·of·this·item."""
214 ········return·deepcopy(self)214 ········return·deepcopy(self)
  
  
215 ===============================================================================215 ===============================================================================
216 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.216 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
217 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.217 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.17 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/link.html
    
Offset 215, 15 lines modifiedOffset 215, 15 lines modified
215 ··········</div>215 ··········</div>
216 ··········<footer>216 ··········<footer>
  
217 ··<hr/>217 ··<hr/>
  
218 ··<div·role="contentinfo">218 ··<div·role="contentinfo">
219 ····<p>&#169;·Copyright·Scrapy·developers.219 ····<p>&#169;·Copyright·Scrapy·developers.
220 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.220 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
221 ······</span></p>221 ······</span></p>
222 ··</div>222 ··</div>
  
223 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a223 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
224 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>224 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
225 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.225 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
226 ···226 ···
⊟
552 B
html2text {}
    
Offset 126, 9 lines modifiedOffset 126, 9 lines modified
126 ····def·__repr__(self)·->·str:126 ····def·__repr__(self)·->·str:
127 ········return·(127 ········return·(
128 ············f"Link(url={self.url!r},·text={self.text!r},·"128 ············f"Link(url={self.url!r},·text={self.text!r},·"
129 ············f"fragment={self.fragment!r},·nofollow={self.nofollow!r})"129 ············f"fragment={self.fragment!r},·nofollow={self.nofollow!r})"
130 ········)130 ········)
  
131 ===============================================================================131 ===============================================================================
132 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.132 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
133 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.133 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.22 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/linkextractors/lxmlhtml.html
    
Offset 442, 15 lines modifiedOffset 442, 15 lines modified
442 ··········</div>442 ··········</div>
443 ··········<footer>443 ··········<footer>
  
444 ··<hr/>444 ··<hr/>
  
445 ··<div·role="contentinfo">445 ··<div·role="contentinfo">
446 ····<p>&#169;·Copyright·Scrapy·developers.446 ····<p>&#169;·Copyright·Scrapy·developers.
447 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.447 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
448 ······</span></p>448 ······</span></p>
449 ··</div>449 ··</div>
  
450 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a450 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
451 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>451 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
452 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.452 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
453 ···453 ···
⊟
562 B
html2text {}
    
Offset 360, 9 lines modifiedOffset 360, 9 lines modified
360 ············all_links.extend(self._process_links(links))360 ············all_links.extend(self._process_links(links))
361 ········if·self.link_extractor.unique:361 ········if·self.link_extractor.unique:
362 ············return·unique_list(all_links,·key=self.link_extractor.link_key)362 ············return·unique_list(all_links,·key=self.link_extractor.link_key)
363 ········return·all_links363 ········return·all_links
  
  
364 ===============================================================================364 ===============================================================================
365 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.365 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
366 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.366 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.18 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/loader.html
    
Offset 260, 15 lines modifiedOffset 260, 15 lines modified
260 ··········</div>260 ··········</div>
261 ··········<footer>261 ··········<footer>
  
262 ··<hr/>262 ··<hr/>
  
263 ··<div·role="contentinfo">263 ··<div·role="contentinfo">
264 ····<p>&#169;·Copyright·Scrapy·developers.264 ····<p>&#169;·Copyright·Scrapy·developers.
265 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.265 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
266 ······</span></p>266 ······</span></p>
267 ··</div>267 ··</div>
  
268 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a268 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
269 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>269 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
270 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.270 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
271 ···271 ···
⊟
554 B
html2text {}
    
Offset 174, 9 lines modifiedOffset 174, 9 lines modified
174 ············except·AttributeError:174 ············except·AttributeError:
175 ················selector·=·None175 ················selector·=·None
176 ········context.update(response=response)176 ········context.update(response=response)
177 ········super().__init__(item=item,·selector=selector,·parent=parent,177 ········super().__init__(item=item,·selector=selector,·parent=parent,
178 **context)178 **context)
  
179 ===============================================================================179 ===============================================================================
180 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.180 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
181 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.181 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.1 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/logformatter.html
    
Offset 370, 15 lines modifiedOffset 370, 15 lines modified
370 ··········</div>370 ··········</div>
371 ··········<footer>371 ··········<footer>
  
372 ··<hr/>372 ··<hr/>
  
373 ··<div·role="contentinfo">373 ··<div·role="contentinfo">
374 ····<p>&#169;·Copyright·Scrapy·developers.374 ····<p>&#169;·Copyright·Scrapy·developers.
375 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.375 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
376 ······</span></p>376 ······</span></p>
377 ··</div>377 ··</div>
  
378 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a378 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
379 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>379 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
380 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.380 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
381 ···381 ···
⊟
457 B
html2text {}
    
Offset 295, 9 lines modifiedOffset 295, 9 lines modified
  
  
295 ····@classmethod295 ····@classmethod
296 ····def·from_crawler(cls,·crawler:·Crawler)·->·Self:296 ····def·from_crawler(cls,·crawler:·Crawler)·->·Self:
297 ········return·cls()297 ········return·cls()
  
298 ===============================================================================298 ===============================================================================
299 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.299 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
300 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.300 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.1 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/mail.html
    
Offset 407, 15 lines modifiedOffset 407, 15 lines modified
407 ··········</div>407 ··········</div>
408 ··········<footer>408 ··········<footer>
  
409 ··<hr/>409 ··<hr/>
  
410 ··<div·role="contentinfo">410 ··<div·role="contentinfo">
411 ····<p>&#169;·Copyright·Scrapy·developers.411 ····<p>&#169;·Copyright·Scrapy·developers.
412 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.412 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
413 ······</span></p>413 ······</span></p>
414 ··</div>414 ··</div>
  
415 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a415 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
416 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>416 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
417 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.417 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
418 ···418 ···
⊟
474 B
html2text {}
    
Offset 318, 9 lines modifiedOffset 318, 9 lines modified
318 ············d,318 ············d,
319 ············**factory_keywords,319 ············**factory_keywords,
320 ········)320 ········)
321 ········factory.noisy·=·False321 ········factory.noisy·=·False
322 ········return·factory322 ········return·factory
  
323 ===============================================================================323 ===============================================================================
324 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.324 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
325 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.325 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.22 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/pipelines/files.html
    
Offset 909, 15 lines modifiedOffset 909, 15 lines modified
909 ··········</div>909 ··········</div>
910 ··········<footer>910 ··········<footer>
  
911 ··<hr/>911 ··<hr/>
  
912 ··<div·role="contentinfo">912 ··<div·role="contentinfo">
913 ····<p>&#169;·Copyright·Scrapy·developers.913 ····<p>&#169;·Copyright·Scrapy·developers.
914 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.914 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
915 ······</span></p>915 ······</span></p>
916 ··</div>916 ··</div>
  
917 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a917 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
918 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>918 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
919 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.919 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
920 ···920 ···
⊟
578 B
html2text {}
    
Offset 856, 9 lines modifiedOffset 856, 9 lines modified
856 ············media_type·=·mimetypes.guess_type(request.url)[0]856 ············media_type·=·mimetypes.guess_type(request.url)[0]
857 ············if·media_type:857 ············if·media_type:
858 ················media_ext·=·cast(str,·mimetypes.guess_extension(media_type))858 ················media_ext·=·cast(str,·mimetypes.guess_extension(media_type))
859 ········return·f"full/{media_guid}{media_ext}"859 ········return·f"full/{media_guid}{media_ext}"
  
  
860 ===============================================================================860 ===============================================================================
861 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.861 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
862 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.862 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.18 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/pipelines/images.html
    
Offset 440, 15 lines modifiedOffset 440, 15 lines modified
440 ··········</div>440 ··········</div>
441 ··········<footer>441 ··········<footer>
  
442 ··<hr/>442 ··<hr/>
  
443 ··<div·role="contentinfo">443 ··<div·role="contentinfo">
444 ····<p>&#169;·Copyright·Scrapy·developers.444 ····<p>&#169;·Copyright·Scrapy·developers.
445 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.445 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
446 ······</span></p>446 ······</span></p>
447 ··</div>447 ··</div>
  
448 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a448 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
449 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>449 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
450 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.450 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
451 ···451 ···
⊟
536 B
html2text {}
    
Offset 361, 9 lines modifiedOffset 361, 9 lines modified
361 ········item:·Any·=·None,361 ········item:·Any·=·None,
362 ····)·->·str:362 ····)·->·str:
363 ········thumb_guid·=·hashlib.sha1(to_bytes(request.url)).hexdigest()··#·nosec363 ········thumb_guid·=·hashlib.sha1(to_bytes(request.url)).hexdigest()··#·nosec
364 ········return·f"thumbs/{thumb_id}/{thumb_guid}.jpg"364 ········return·f"thumbs/{thumb_id}/{thumb_guid}.jpg"
  
  
365 ===============================================================================365 ===============================================================================
366 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.366 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
367 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.367 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.21 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/robotstxt.html
    
Offset 289, 15 lines modifiedOffset 289, 15 lines modified
289 ··········</div>289 ··········</div>
290 ··········<footer>290 ··········<footer>
  
291 ··<hr/>291 ··<hr/>
  
292 ··<div·role="contentinfo">292 ··<div·role="contentinfo">
293 ····<p>&#169;·Copyright·Scrapy·developers.293 ····<p>&#169;·Copyright·Scrapy·developers.
294 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.294 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
295 ······</span></p>295 ······</span></p>
296 ··</div>296 ··</div>
  
297 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a297 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
298 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>298 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
299 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.299 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
300 ···300 ···
⊟
579 B
html2text {}
    
Offset 203, 9 lines modifiedOffset 203, 9 lines modified
203 ········return·o203 ········return·o
  
204 ····def·allowed(self,·url:·str·|·bytes,·user_agent:·str·|·bytes)·->·bool:204 ····def·allowed(self,·url:·str·|·bytes,·user_agent:·str·|·bytes)·->·bool:
205 ········user_agent·=·to_unicode(user_agent)205 ········user_agent·=·to_unicode(user_agent)
206 ········url·=·to_unicode(url)206 ········url·=·to_unicode(url)
207 ········return·self.rp.can_fetch(url,·user_agent)207 ········return·self.rp.can_fetch(url,·user_agent)
208 ===============================================================================208 ===============================================================================
209 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.209 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
210 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.210 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.13 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/selector/unified.html
    
Offset 259, 15 lines modifiedOffset 259, 15 lines modified
259 ··········</div>259 ··········</div>
260 ··········<footer>260 ··········<footer>
  
261 ··<hr/>261 ··<hr/>
  
262 ··<div·role="contentinfo">262 ··<div·role="contentinfo">
263 ····<p>&#169;·Copyright·Scrapy·developers.263 ····<p>&#169;·Copyright·Scrapy·developers.
264 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.264 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
265 ······</span></p>265 ······</span></p>
266 ··</div>266 ··</div>
  
267 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a267 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
268 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>268 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
269 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.269 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
270 ···270 ···
⊟
488 B
html2text {}
    
Offset 168, 9 lines modifiedOffset 168, 9 lines modified
  
168 ········if·root·is·not·_NOT_SET:168 ········if·root·is·not·_NOT_SET:
169 ············kwargs["root"]·=·root169 ············kwargs["root"]·=·root
  
170 ········super().__init__(text=text,·type=st,·**kwargs)170 ········super().__init__(text=text,·type=st,·**kwargs)
  
171 ===============================================================================171 ===============================================================================
172 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.172 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
173 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.173 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.27 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/settings.html
    
Offset 765, 15 lines modifiedOffset 765, 15 lines modified
765 ··········</div>765 ··········</div>
766 ··········<footer>766 ··········<footer>
  
767 ··<hr/>767 ··<hr/>
  
768 ··<div·role="contentinfo">768 ··<div·role="contentinfo">
769 ····<p>&#169;·Copyright·Scrapy·developers.769 ····<p>&#169;·Copyright·Scrapy·developers.
770 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.770 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
771 ······</span></p>771 ······</span></p>
772 ··</div>772 ··</div>
  
773 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a773 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
774 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>774 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
775 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.775 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
776 ···776 ···
⊟
643 B
html2text {}
    
Offset 706, 9 lines modifiedOffset 706, 9 lines modified
706 )·->·Iterable[tuple[str,·Any]]:706 )·->·Iterable[tuple[str,·Any]]:
707 ····"""Return·an·iterable·of·the·settings·that·have·been·overridden"""707 ····"""Return·an·iterable·of·the·settings·that·have·been·overridden"""
708 ····for·name,·defvalue·in·iter_default_settings():708 ····for·name,·defvalue·in·iter_default_settings():
709 ········value·=·settings[name]709 ········value·=·settings[name]
710 ········if·not·isinstance(defvalue,·dict)·and·value·!=·defvalue:710 ········if·not·isinstance(defvalue,·dict)·and·value·!=·defvalue:
711 ············yield·name,·value711 ············yield·name,·value
712 ===============================================================================712 ===============================================================================
713 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.713 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
714 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.714 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.14 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/signalmanager.html
    
Offset 246, 15 lines modifiedOffset 246, 15 lines modified
246 ··········</div>246 ··········</div>
247 ··········<footer>247 ··········<footer>
  
248 ··<hr/>248 ··<hr/>
  
249 ··<div·role="contentinfo">249 ··<div·role="contentinfo">
250 ····<p>&#169;·Copyright·Scrapy·developers.250 ····<p>&#169;·Copyright·Scrapy·developers.
251 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.251 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
252 ······</span></p>252 ······</span></p>
253 ··</div>253 ··</div>
  
254 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a254 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
255 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>255 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
256 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.256 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
257 ···257 ···
⊟
504 B
html2text {}
    
Offset 156, 9 lines modifiedOffset 156, 9 lines modified
156 ········:type·signal:·object156 ········:type·signal:·object
157 ········"""157 ········"""
158 ········kwargs.setdefault("sender",·self.sender)158 ········kwargs.setdefault("sender",·self.sender)
159 ········_signal.disconnect_all(signal,·**kwargs)159 ········_signal.disconnect_all(signal,·**kwargs)
  
  
160 ===============================================================================160 ===============================================================================
161 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.161 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
162 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.162 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.15 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/spiderloader.html
    
Offset 271, 15 lines modifiedOffset 271, 15 lines modified
271 ··········</div>271 ··········</div>
272 ··········<footer>272 ··········<footer>
  
273 ··<hr/>273 ··<hr/>
  
274 ··<div·role="contentinfo">274 ··<div·role="contentinfo">
275 ····<p>&#169;·Copyright·Scrapy·developers.275 ····<p>&#169;·Copyright·Scrapy·developers.
276 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.276 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
277 ······</span></p>277 ······</span></p>
278 ··</div>278 ··</div>
  
279 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a279 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
280 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>280 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
281 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.281 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
282 ···282 ···
⊟
509 B
html2text {}
    
Offset 181, 9 lines modifiedOffset 181, 9 lines modified
181 ········"""181 ········"""
182 ········Return·a·list·with·the·names·of·all·spiders·available·in·the·project.182 ········Return·a·list·with·the·names·of·all·spiders·available·in·the·project.
183 ········"""183 ········"""
184 ········return·list(self._spiders.keys())184 ········return·list(self._spiders.keys())
  
  
185 ===============================================================================185 ===============================================================================
186 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.186 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
187 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.187 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.25 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/spidermiddlewares/depth.html
    
Offset 242, 15 lines modifiedOffset 242, 15 lines modified
242 ··········</div>242 ··········</div>
243 ··········<footer>243 ··········<footer>
  
244 ··<hr/>244 ··<hr/>
  
245 ··<div·role="contentinfo">245 ··<div·role="contentinfo">
246 ····<p>&#169;·Copyright·Scrapy·developers.246 ····<p>&#169;·Copyright·Scrapy·developers.
247 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.247 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
248 ······</span></p>248 ······</span></p>
249 ··</div>249 ··</div>
  
250 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a250 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
251 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>251 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
252 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.252 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
253 ···253 ···
⊟
592 B
html2text {}
    
Offset 148, 9 lines modifiedOffset 148, 9 lines modified
148 ············return·False148 ············return·False
149 ········if·self.verbose_stats:149 ········if·self.verbose_stats:
150 ············self.stats.inc_value(f"request_depth_count/{depth}",·spider=spider)150 ············self.stats.inc_value(f"request_depth_count/{depth}",·spider=spider)
151 ········self.stats.max_value("request_depth_max",·depth,·spider=spider)151 ········self.stats.max_value("request_depth_max",·depth,·spider=spider)
152 ········return·True152 ········return·True
  
153 ===============================================================================153 ===============================================================================
154 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.154 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
155 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.155 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.17 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/spidermiddlewares/httperror.html
    
Offset 235, 15 lines modifiedOffset 235, 15 lines modified
235 ··········</div>235 ··········</div>
236 ··········<footer>236 ··········<footer>
  
237 ··<hr/>237 ··<hr/>
  
238 ··<div·role="contentinfo">238 ··<div·role="contentinfo">
239 ····<p>&#169;·Copyright·Scrapy·developers.239 ····<p>&#169;·Copyright·Scrapy·developers.
240 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.240 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
241 ······</span></p>241 ······</span></p>
242 ··</div>242 ··</div>
  
243 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a243 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
244 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>244 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
245 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.245 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
246 ···246 ···
⊟
502 B
html2text {}
    
Offset 142, 9 lines modifiedOffset 142, 9 lines modified
142 ················{"response":·response},142 ················{"response":·response},
143 ················extra={"spider":·spider},143 ················extra={"spider":·spider},
144 ············)144 ············)
145 ············return·[]145 ············return·[]
146 ········return·None146 ········return·None
  
147 ===============================================================================147 ===============================================================================
148 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.148 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
149 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.149 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.29 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/spidermiddlewares/referer.html
    
Offset 595, 15 lines modifiedOffset 595, 15 lines modified
595 ··········</div>595 ··········</div>
596 ··········<footer>596 ··········<footer>
  
597 ··<hr/>597 ··<hr/>
  
598 ··<div·role="contentinfo">598 ··<div·role="contentinfo">
599 ····<p>&#169;·Copyright·Scrapy·developers.599 ····<p>&#169;·Copyright·Scrapy·developers.
600 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.600 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
601 ······</span></p>601 ······</span></p>
602 ··</div>602 ··</div>
  
603 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a603 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
604 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>604 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
605 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.605 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
606 ···606 ···
⊟
635 B
html2text {}
    
Offset 533, 9 lines modifiedOffset 533, 9 lines modified
533 ················if·policy_referrer·!=·request_referrer.decode("latin1"):533 ················if·policy_referrer·!=·request_referrer.decode("latin1"):
534 ····················if·policy_referrer·is·None:534 ····················if·policy_referrer·is·None:
535 ························request.headers.pop("Referer")535 ························request.headers.pop("Referer")
536 ····················else:536 ····················else:
537 ························request.headers["Referer"]·=·policy_referrer537 ························request.headers["Referer"]·=·policy_referrer
  
538 ===============================================================================538 ===============================================================================
539 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.539 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
540 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.540 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.2 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/spidermiddlewares/urllength.html
    
Offset 232, 15 lines modifiedOffset 232, 15 lines modified
232 ··········</div>232 ··········</div>
233 ··········<footer>233 ··········<footer>
  
234 ··<hr/>234 ··<hr/>
  
235 ··<div·role="contentinfo">235 ··<div·role="contentinfo">
236 ····<p>&#169;·Copyright·Scrapy·developers.236 ····<p>&#169;·Copyright·Scrapy·developers.
237 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.237 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
238 ······</span></p>238 ······</span></p>
239 ··</div>239 ··</div>
  
240 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a240 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
241 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>241 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
242 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.242 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
243 ···243 ···
⊟
532 B
html2text {}
    
Offset 138, 9 lines modifiedOffset 138, 9 lines modified
138 ············spider.crawler.stats.inc_value(138 ············spider.crawler.stats.inc_value(
139 ················"urllength/request_ignored_count",·spider=spider139 ················"urllength/request_ignored_count",·spider=spider
140 ············)140 ············)
141 ············return·False141 ············return·False
142 ········return·True142 ········return·True
  
143 ===============================================================================143 ===============================================================================
144 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.144 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
145 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.145 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.2 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/spiders/crawl.html
    
Offset 353, 15 lines modifiedOffset 353, 15 lines modified
353 ··········</div>353 ··········</div>
354 ··········<footer>354 ··········<footer>
  
355 ··<hr/>355 ··<hr/>
  
356 ··<div·role="contentinfo">356 ··<div·role="contentinfo">
357 ····<p>&#169;·Copyright·Scrapy·developers.357 ····<p>&#169;·Copyright·Scrapy·developers.
358 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.358 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
359 ······</span></p>359 ······</span></p>
360 ··</div>360 ··</div>
  
361 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a361 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
362 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>362 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
363 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.363 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
364 ···364 ···
⊟
562 B
html2text {}
    
Offset 268, 9 lines modifiedOffset 268, 9 lines modified
268 ········spider·=·super().from_crawler(crawler,·*args,·**kwargs)268 ········spider·=·super().from_crawler(crawler,·*args,·**kwargs)
269 ········spider._follow_links·=·crawler.settings.getbool(269 ········spider._follow_links·=·crawler.settings.getbool(
270 ············"CRAWLSPIDER_FOLLOW_LINKS",·True270 ············"CRAWLSPIDER_FOLLOW_LINKS",·True
271 ········)271 ········)
272 ········return·spider272 ········return·spider
  
273 ===============================================================================273 ===============================================================================
274 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.274 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
275 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.275 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.19 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/spiders/feed.html
    
Offset 330, 15 lines modifiedOffset 330, 15 lines modified
330 ··········</div>330 ··········</div>
331 ··········<footer>331 ··········<footer>
  
332 ··<hr/>332 ··<hr/>
  
333 ··<div·role="contentinfo">333 ··<div·role="contentinfo">
334 ····<p>&#169;·Copyright·Scrapy·developers.334 ····<p>&#169;·Copyright·Scrapy·developers.
335 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.335 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
336 ······</span></p>336 ······</span></p>
337 ··</div>337 ··</div>
  
338 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a338 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
339 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>339 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
340 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.340 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
341 ···341 ···
⊟
552 B
html2text {}
    
Offset 249, 9 lines modifiedOffset 249, 9 lines modified
249 ················"You·must·define·parse_row·method·in·order·to·scrape·this·CSV249 ················"You·must·define·parse_row·method·in·order·to·scrape·this·CSV
250 feed"250 feed"
251 ············)251 ············)
252 ········response·=·self.adapt_response(response)252 ········response·=·self.adapt_response(response)
253 ········return·self.parse_rows(response)253 ········return·self.parse_rows(response)
  
254 ===============================================================================254 ===============================================================================
255 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.255 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
256 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.256 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.19 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/spiders/sitemap.html
    
Offset 299, 15 lines modifiedOffset 299, 15 lines modified
299 ··········</div>299 ··········</div>
300 ··········<footer>300 ··········<footer>
  
301 ··<hr/>301 ··<hr/>
  
302 ··<div·role="contentinfo">302 ··<div·role="contentinfo">
303 ····<p>&#169;·Copyright·Scrapy·developers.303 ····<p>&#169;·Copyright·Scrapy·developers.
304 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.304 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
305 ······</span></p>305 ······</span></p>
306 ··</div>306 ··</div>
  
307 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a307 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
308 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>308 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
309 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.309 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
310 ···310 ···
⊟
547 B
html2text {}
    
Offset 212, 9 lines modifiedOffset 212, 9 lines modified
212 ····for·d·in·it:212 ····for·d·in·it:
213 ········yield·d["loc"]213 ········yield·d["loc"]
  
214 ········#·Also·consider·alternate·URLs·(xhtml:link·rel="alternate")214 ········#·Also·consider·alternate·URLs·(xhtml:link·rel="alternate")
215 ········if·alt·and·"alternate"·in·d:215 ········if·alt·and·"alternate"·in·d:
216 ············yield·from·d["alternate"]216 ············yield·from·d["alternate"]
217 ===============================================================================217 ===============================================================================
218 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.218 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
219 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.219 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.12 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/statscollectors.html
    
Offset 291, 15 lines modifiedOffset 291, 15 lines modified
291 ··········</div>291 ··········</div>
292 ··········<footer>292 ··········<footer>
  
293 ··<hr/>293 ··<hr/>
  
294 ··<div·role="contentinfo">294 ··<div·role="contentinfo">
295 ····<p>&#169;·Copyright·Scrapy·developers.295 ····<p>&#169;·Copyright·Scrapy·developers.
296 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.296 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
297 ······</span></p>297 ······</span></p>
298 ··</div>298 ··</div>
  
299 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a299 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
300 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>300 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
301 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.301 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
302 ···302 ···
⊟
477 B
html2text {}
    
Offset 216, 9 lines modifiedOffset 216, 9 lines modified
216 ········pass216 ········pass
  
217 ····def·min_value(self,·key:·str,·value:·Any,·spider:·Spider·|·None·=·None)·-217 ····def·min_value(self,·key:·str,·value:·Any,·spider:·Spider·|·None·=·None)·-
218 >·None:218 >·None:
219 ········pass219 ········pass
  
220 ===============================================================================220 ===============================================================================
221 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.221 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
222 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.222 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.17 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/utils/curl.html
    
Offset 284, 15 lines modifiedOffset 284, 15 lines modified
284 ··········</div>284 ··········</div>
285 ··········<footer>285 ··········<footer>
  
286 ··<hr/>286 ··<hr/>
  
287 ··<div·role="contentinfo">287 ··<div·role="contentinfo">
288 ····<p>&#169;·Copyright·Scrapy·developers.288 ····<p>&#169;·Copyright·Scrapy·developers.
289 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.289 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
290 ······</span></p>290 ······</span></p>
291 ··</div>291 ··</div>
  
292 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a292 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
293 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>293 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
294 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.294 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
295 ···295 ···
⊟
540 B
html2text {}
    
Offset 190, 9 lines modifiedOffset 190, 9 lines modified
190 ············#·if·the·"data"·is·specified·but·the·"method"·is·not·specified,190 ············#·if·the·"data"·is·specified·but·the·"method"·is·not·specified,
191 ············#·the·default·method·is·'POST'191 ············#·the·default·method·is·'POST'
192 ············result["method"]·=·"POST"192 ············result["method"]·=·"POST"
  
193 ····return·result193 ····return·result
  
194 ===============================================================================194 ===============================================================================
195 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.195 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
196 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.196 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.18 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/utils/defer.html
    
Offset 620, 15 lines modifiedOffset 620, 15 lines modified
620 ··········</div>620 ··········</div>
621 ··········<footer>621 ··········<footer>
  
622 ··<hr/>622 ··<hr/>
  
623 ··<div·role="contentinfo">623 ··<div·role="contentinfo">
624 ····<p>&#169;·Copyright·Scrapy·developers.624 ····<p>&#169;·Copyright·Scrapy·developers.
625 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.625 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
626 ······</span></p>626 ······</span></p>
627 ··</div>627 ··</div>
  
628 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a628 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
629 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>629 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
630 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.630 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
631 ···631 ···
⊟
544 B
html2text {}
    
Offset 556, 9 lines modifiedOffset 556, 9 lines modified
556 ················additional_response·=·await·maybe_deferred_to_future(deferred)556 ················additional_response·=·await·maybe_deferred_to_future(deferred)
557 ····"""557 ····"""
558 ····if·not·is_asyncio_reactor_installed():558 ····if·not·is_asyncio_reactor_installed():
559 ········return·d559 ········return·d
560 ····return·deferred_to_future(d)560 ····return·deferred_to_future(d)
  
561 ===============================================================================561 ===============================================================================
562 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.562 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
563 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.563 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.25 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/utils/iterators.html
    
Offset 400, 15 lines modifiedOffset 400, 15 lines modified
400 ··········</div>400 ··········</div>
401 ··········<footer>401 ··········<footer>
  
402 ··<hr/>402 ··<hr/>
  
403 ··<div·role="contentinfo">403 ··<div·role="contentinfo">
404 ····<p>&#169;·Copyright·Scrapy·developers.404 ····<p>&#169;·Copyright·Scrapy·developers.
405 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.405 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
406 ······</span></p>406 ······</span></p>
407 ··</div>407 ··</div>
  
408 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a408 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
409 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>409 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
410 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.410 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
411 ···411 ···
⊟
608 B
html2text {}
    
Offset 313, 9 lines modifiedOffset 313, 9 lines modified
313 ········if·isinstance(obj,·TextResponse):313 ········if·isinstance(obj,·TextResponse):
314 ············return·obj.text314 ············return·obj.text
315 ········return·obj.body.decode("utf-8")315 ········return·obj.body.decode("utf-8")
316 ····if·isinstance(obj,·str):316 ····if·isinstance(obj,·str):
317 ········return·obj·if·unicode·else·obj.encode("utf-8")317 ········return·obj·if·unicode·else·obj.encode("utf-8")
318 ····return·obj.decode("utf-8")·if·unicode·else·obj318 ····return·obj.decode("utf-8")·if·unicode·else·obj
319 ===============================================================================319 ===============================================================================
320 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.320 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
321 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.321 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.18 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/utils/log.html
    
Offset 415, 15 lines modifiedOffset 415, 15 lines modified
415 ··········</div>415 ··········</div>
416 ··········<footer>416 ··········<footer>
  
417 ··<hr/>417 ··<hr/>
  
418 ··<div·role="contentinfo">418 ··<div·role="contentinfo">
419 ····<p>&#169;·Copyright·Scrapy·developers.419 ····<p>&#169;·Copyright·Scrapy·developers.
420 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.420 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
421 ······</span></p>421 ······</span></p>
422 ··</div>422 ··</div>
  
423 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a423 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
424 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>424 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
425 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.425 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
426 ···426 ···
⊟
553 B
html2text {}
    
Offset 325, 9 lines modifiedOffset 325, 9 lines modified
325 ········if·isinstance(kwargs.get("extra"),·MutableMapping):325 ········if·isinstance(kwargs.get("extra"),·MutableMapping):
326 ············kwargs["extra"].update(self.extra)326 ············kwargs["extra"].update(self.extra)
327 ········else:327 ········else:
328 ············kwargs["extra"]·=·self.extra328 ············kwargs["extra"]·=·self.extra
  
329 ········return·msg,·kwargs329 ········return·msg,·kwargs
330 ===============================================================================330 ===============================================================================
331 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.331 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
332 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.332 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.27 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/utils/misc.html
    
Offset 460, 15 lines modifiedOffset 460, 15 lines modified
460 ··········</div>460 ··········</div>
461 ··········<footer>461 ··········<footer>
  
462 ··<hr/>462 ··<hr/>
  
463 ··<div·role="contentinfo">463 ··<div·role="contentinfo">
464 ····<p>&#169;·Copyright·Scrapy·developers.464 ····<p>&#169;·Copyright·Scrapy·developers.
465 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.465 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
466 ······</span></p>466 ······</span></p>
467 ··</div>467 ··</div>
  
468 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a468 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
469 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>469 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
470 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.470 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
471 ···471 ···
⊟
639 B
html2text {}
    
Offset 384, 9 lines modifiedOffset 384, 9 lines modified
384 ············f'potential·issues·in·your·implementation·of·"{callable_name}".384 ············f'potential·issues·in·your·implementation·of·"{callable_name}".
385 Please,·report·this·in·the·'385 Please,·report·this·in·the·'
386 ············"Scrapy·issue·tracker·(https://github.com/scrapy/scrapy/issues),·"386 ············"Scrapy·issue·tracker·(https://github.com/scrapy/scrapy/issues),·"
387 ············f'including·the·code·of·"{callable_name}"',387 ············f'including·the·code·of·"{callable_name}"',
388 ············stacklevel=2,388 ············stacklevel=2,
389 ········)389 ········)
390 ===============================================================================390 ===============================================================================
391 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.391 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
392 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.392 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.15 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/utils/python.html
    
Offset 548, 15 lines modifiedOffset 548, 15 lines modified
548 ··········</div>548 ··········</div>
549 ··········<footer>549 ··········<footer>
  
550 ··<hr/>550 ··<hr/>
  
551 ··<div·role="contentinfo">551 ··<div·role="contentinfo">
552 ····<p>&#169;·Copyright·Scrapy·developers.552 ····<p>&#169;·Copyright·Scrapy·developers.
553 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.553 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
554 ······</span></p>554 ······</span></p>
555 ··</div>555 ··</div>
  
556 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a556 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
557 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>557 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
558 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.558 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
559 ···559 ···
⊟
511 B
html2text {}
    
Offset 469, 9 lines modifiedOffset 469, 9 lines modified
  
469 ····def·__aiter__(self)·->·AsyncIterator[_T]:469 ····def·__aiter__(self)·->·AsyncIterator[_T]:
470 ········return·self470 ········return·self
  
471 ····async·def·__anext__(self)·->·_T:471 ····async·def·__anext__(self)·->·_T:
472 ········return·await·self.data.__anext__()472 ········return·await·self.data.__anext__()
473 ===============================================================================473 ===============================================================================
474 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.474 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
475 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.475 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.16 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/utils/reactor.html
    
Offset 336, 15 lines modifiedOffset 336, 15 lines modified
336 ··········</div>336 ··········</div>
337 ··········<footer>337 ··········<footer>
  
338 ··<hr/>338 ··<hr/>
  
339 ··<div·role="contentinfo">339 ··<div·role="contentinfo">
340 ····<p>&#169;·Copyright·Scrapy·developers.340 ····<p>&#169;·Copyright·Scrapy·developers.
341 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.341 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
342 ······</span></p>342 ······</span></p>
343 ··</div>343 ··</div>
  
344 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a344 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
345 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>345 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
346 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.346 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
347 ···347 ···
⊟
521 B
html2text {}
    
Offset 247, 9 lines modifiedOffset 247, 9 lines modified
  
  
247 def·is_asyncio_reactor_installed()·->·bool:247 def·is_asyncio_reactor_installed()·->·bool:
248 ····from·twisted.internet·import·reactor248 ····from·twisted.internet·import·reactor
  
249 ····return·isinstance(reactor,·asyncioreactor.AsyncioSelectorReactor)249 ····return·isinstance(reactor,·asyncioreactor.AsyncioSelectorReactor)
250 ===============================================================================250 ===============================================================================
251 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.251 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
252 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.252 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.19 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/utils/request.html
    
Offset 395, 15 lines modifiedOffset 395, 15 lines modified
395 ··········</div>395 ··········</div>
396 ··········<footer>396 ··········<footer>
  
397 ··<hr/>397 ··<hr/>
  
398 ··<div·role="contentinfo">398 ··<div·role="contentinfo">
399 ····<p>&#169;·Copyright·Scrapy·developers.399 ····<p>&#169;·Copyright·Scrapy·developers.
400 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.400 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
401 ······</span></p>401 ······</span></p>
402 ··</div>402 ··</div>
  
403 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a403 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
404 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>404 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
405 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.405 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
406 ···406 ···
⊟
553 B
html2text {}
    
Offset 315, 9 lines modifiedOffset 315, 9 lines modified
315 request.cookies315 request.cookies
316 ············)316 ············)
317 ············cookies·=·f"--cookie·'{cookie}'"317 ············cookies·=·f"--cookie·'{cookie}'"
  
318 ····curl_cmd·=·f"curl·-X·{method}·{url}·{data}·{headers}·{cookies}".strip()318 ····curl_cmd·=·f"curl·-X·{method}·{url}·{data}·{headers}·{cookies}".strip()
319 ····return·"·".join(curl_cmd.split())319 ····return·"·".join(curl_cmd.split())
320 ===============================================================================320 ===============================================================================
321 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.321 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
322 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.322 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.16 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/utils/response.html
    
Offset 265, 15 lines modifiedOffset 265, 15 lines modified
265 ··········</div>265 ··········</div>
266 ··········<footer>266 ··········<footer>
  
267 ··<hr/>267 ··<hr/>
  
268 ··<div·role="contentinfo">268 ··<div·role="contentinfo">
269 ····<p>&#169;·Copyright·Scrapy·developers.269 ····<p>&#169;·Copyright·Scrapy·developers.
270 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.270 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
271 ······</span></p>271 ······</span></p>
272 ··</div>272 ··</div>
  
273 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a273 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
274 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>274 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
275 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.275 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
276 ···276 ···
⊟
514 B
html2text {}
    
Offset 173, 9 lines modifiedOffset 173, 9 lines modified
173 {response.__class__.__name__}")173 {response.__class__.__name__}")
174 ····fd,·fname·=·tempfile.mkstemp(ext)174 ····fd,·fname·=·tempfile.mkstemp(ext)
175 ····os.write(fd,·body)175 ····os.write(fd,·body)
176 ····os.close(fd)176 ····os.close(fd)
177 ····return·_openfunc(f"file://{fname}")177 ····return·_openfunc(f"file://{fname}")
  
178 ===============================================================================178 ===============================================================================
179 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.179 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
180 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.180 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.2 KB
./usr/share/doc/python-scrapy-doc/html/_modules/scrapy/utils/trackref.html
    
Offset 240, 15 lines modifiedOffset 240, 15 lines modified
240 ··········</div>240 ··········</div>
241 ··········<footer>241 ··········<footer>
  
242 ··<hr/>242 ··<hr/>
  
243 ··<div·role="contentinfo">243 ··<div·role="contentinfo">
244 ····<p>&#169;·Copyright·Scrapy·developers.244 ····<p>&#169;·Copyright·Scrapy·developers.
245 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.245 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
246 ······</span></p>246 ······</span></p>
247 ··</div>247 ··</div>
  
248 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a248 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
249 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>249 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
250 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.250 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
251 ···251 ···
⊟
561 B
html2text {}
    
Offset 150, 9 lines modifiedOffset 150, 9 lines modified
150 ····"""Iterate·over·all·objects·of·the·same·class·by·its·class·name"""150 ····"""Iterate·over·all·objects·of·the·same·class·by·its·class·name"""
151 ····for·cls,·wdict·in·live_refs.items():151 ····for·cls,·wdict·in·live_refs.items():
152 ········if·cls.__name__·==·class_name:152 ········if·cls.__name__·==·class_name:
153 ············return·wdict.keys()153 ············return·wdict.keys()
154 ····return·[]154 ····return·[]
  
155 ===============================================================================155 ===============================================================================
156 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.156 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
157 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.157 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.36 KB
./usr/share/doc/python-scrapy-doc/html/contributing.html
    
Offset 424, 15 lines modifiedOffset 424, 15 lines modified
424 ········<a·href="versioning.html"·class="btn·btn-neutral·float-right"·title="Versioning·and·API·stability"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>424 ········<a·href="versioning.html"·class="btn·btn-neutral·float-right"·title="Versioning·and·API·stability"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
425 ····</div>425 ····</div>
  
426 ··<hr/>426 ··<hr/>
  
427 ··<div·role="contentinfo">427 ··<div·role="contentinfo">
428 ····<p>&#169;·Copyright·Scrapy·developers.428 ····<p>&#169;·Copyright·Scrapy·developers.
429 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.429 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
430 ······</span></p>430 ······</span></p>
431 ··</div>431 ··</div>
  
432 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a432 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
433 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>433 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
434 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.434 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
435 ···435 ···
⊟
577 B
html2text {}
    
Offset 255, 9 lines modifiedOffset 255, 9 lines modified
255 name·typically·resembles·the·full·path·of·the·module·they’re·testing.·For255 name·typically·resembles·the·full·path·of·the·module·they’re·testing.·For
256 example,·the·item·loaders·code·is·in:256 example,·the·item·loaders·code·is·in:
257 scrapy.loader257 scrapy.loader
258 And·their·unit-tests·are·in:258 And·their·unit-tests·are·in:
259 tests/test_loader.py259 tests/test_loader.py
260 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t260 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
261 ===============================================================================261 ===============================================================================
262 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.262 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
263 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.263 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.74 KB
./usr/share/doc/python-scrapy-doc/html/faq.html
    
Offset 549, 15 lines modifiedOffset 549, 15 lines modified
549 ········<a·href="topics/debug.html"·class="btn·btn-neutral·float-right"·title="Debugging·Spiders"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>549 ········<a·href="topics/debug.html"·class="btn·btn-neutral·float-right"·title="Debugging·Spiders"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
550 ····</div>550 ····</div>
  
551 ··<hr/>551 ··<hr/>
  
552 ··<div·role="contentinfo">552 ··<div·role="contentinfo">
553 ····<p>&#169;·Copyright·Scrapy·developers.553 ····<p>&#169;·Copyright·Scrapy·developers.
554 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.554 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
555 ······</span></p>555 ······</span></p>
556 ··</div>556 ··</div>
  
557 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a557 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
558 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>558 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
559 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.559 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
560 ···560 ···
⊟
996 B
html2text {}
    
Offset 340, 9 lines modifiedOffset 340, 9 lines modified
340 URL·without·any·specific·content.340 URL·without·any·specific·content.
341 *\x8**\x8**\x8**\x8**\x8*·R\x8Ru\x8un\x8nn\x8ni\x8in\x8ng\x8g·r\x8ru\x8un\x8ns\x8sp\x8pi\x8id\x8de\x8er\x8r·I\x8I·g\x8ge\x8et\x8t·e\x8er\x8rr\x8ro\x8or\x8r:\x8:·N\x8No\x8o·s\x8sp\x8pi\x8id\x8de\x8er\x8r·f\x8fo\x8ou\x8un\x8nd\x8d·i\x8in\x8n·f\x8fi\x8il\x8le\x8e:\x8:·<\x8<f\x8fi\x8il\x8le\x8en\x8na\x8am\x8me\x8e>\x8>_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*341 *\x8**\x8**\x8**\x8**\x8*·R\x8Ru\x8un\x8nn\x8ni\x8in\x8ng\x8g·r\x8ru\x8un\x8ns\x8sp\x8pi\x8id\x8de\x8er\x8r·I\x8I·g\x8ge\x8et\x8t·e\x8er\x8rr\x8ro\x8or\x8r:\x8:·N\x8No\x8o·s\x8sp\x8pi\x8id\x8de\x8er\x8r·f\x8fo\x8ou\x8un\x8nd\x8d·i\x8in\x8n·f\x8fi\x8il\x8le\x8e:\x8:·<\x8<f\x8fi\x8il\x8le\x8en\x8na\x8am\x8me\x8e>\x8>_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*
342 This·may·happen·if·your·Scrapy·project·has·a·spider·module·with·a·name·that342 This·may·happen·if·your·Scrapy·project·has·a·spider·module·with·a·name·that
343 conflicts·with·the·name·of·one·of·the·_\x8P_\x8y_\x8t_\x8h_\x8o_\x8n_\x8·_\x8s_\x8t_\x8a_\x8n_\x8d_\x8a_\x8r_\x8d_\x8·_\x8l_\x8i_\x8b_\x8r_\x8a_\x8r_\x8y_\x8·_\x8m_\x8o_\x8d_\x8u_\x8l_\x8e_\x8s,·such·as343 conflicts·with·the·name·of·one·of·the·_\x8P_\x8y_\x8t_\x8h_\x8o_\x8n_\x8·_\x8s_\x8t_\x8a_\x8n_\x8d_\x8a_\x8r_\x8d_\x8·_\x8l_\x8i_\x8b_\x8r_\x8a_\x8r_\x8y_\x8·_\x8m_\x8o_\x8d_\x8u_\x8l_\x8e_\x8s,·such·as
344 csv.py·or·os.py,·or·any·_\x8P_\x8y_\x8t_\x8h_\x8o_\x8n_\x8·_\x8p_\x8a_\x8c_\x8k_\x8a_\x8g_\x8e·that·you·have·installed.·See·_\x8i_\x8s_\x8s_\x8u_\x8e_\x8·_\x82_\x86_\x88_\x80.344 csv.py·or·os.py,·or·any·_\x8P_\x8y_\x8t_\x8h_\x8o_\x8n_\x8·_\x8p_\x8a_\x8c_\x8k_\x8a_\x8g_\x8e·that·you·have·installed.·See·_\x8i_\x8s_\x8s_\x8u_\x8e_\x8·_\x82_\x86_\x88_\x80.
345 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t345 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
346 ===============================================================================346 ===============================================================================
347 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.347 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
348 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.348 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.88 KB
./usr/share/doc/python-scrapy-doc/html/genindex.html
    
Offset 3986, 15 lines modifiedOffset 3986, 15 lines modified
3986 ··········</div>3986 ··········</div>
3987 ··········<footer>3987 ··········<footer>
  
3988 ··<hr/>3988 ··<hr/>
  
3989 ··<div·role="contentinfo">3989 ··<div·role="contentinfo">
3990 ····<p>&#169;·Copyright·Scrapy·developers.3990 ····<p>&#169;·Copyright·Scrapy·developers.
3991 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.3991 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
3992 ······</span></p>3992 ······</span></p>
3993 ··</div>3993 ··</div>
  
3994 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a3994 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
3995 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>3995 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
3996 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.3996 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
3997 ···3997 ···
⊟
1.27 KB
html2text {}
    
Offset 1100, 9 lines modifiedOffset 1100, 9 lines modified
1100 ····*·_\x8X_\x8M_\x8L_\x8F_\x8e_\x8e_\x8d_\x8S_\x8p_\x8i_\x8d_\x8e_\x8r_\x8·_\x8(_\x8c_\x8l_\x8a_\x8s_\x8s_\x8·_\x8i_\x8n·······*·_\x8X_\x8m_\x8l_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e_\x8·_\x8(_\x8c_\x8l_\x8a_\x8s_\x8s_\x8·_\x8i_\x8n_\x8·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8h_\x8t_\x8t_\x8p_\x8)1100 ····*·_\x8X_\x8M_\x8L_\x8F_\x8e_\x8e_\x8d_\x8S_\x8p_\x8i_\x8d_\x8e_\x8r_\x8·_\x8(_\x8c_\x8l_\x8a_\x8s_\x8s_\x8·_\x8i_\x8n·······*·_\x8X_\x8m_\x8l_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e_\x8·_\x8(_\x8c_\x8l_\x8a_\x8s_\x8s_\x8·_\x8i_\x8n_\x8·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8h_\x8t_\x8t_\x8p_\x8)
1101 ······_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8p_\x8i_\x8d_\x8e_\x8r_\x8s_\x8)···············*·_\x8x_\x8p_\x8a_\x8t_\x8h_\x8(_\x8)_\x8·_\x8(_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8h_\x8t_\x8t_\x8p_\x8._\x8T_\x8e_\x8x_\x8t_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e1101 ······_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8p_\x8i_\x8d_\x8e_\x8r_\x8s_\x8)···············*·_\x8x_\x8p_\x8a_\x8t_\x8h_\x8(_\x8)_\x8·_\x8(_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8h_\x8t_\x8t_\x8p_\x8._\x8T_\x8e_\x8x_\x8t_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e
1102 ····*·_\x8X_\x8m_\x8l_\x8I_\x8t_\x8e_\x8m_\x8E_\x8x_\x8p_\x8o_\x8r_\x8t_\x8e_\x8r_\x8·_\x8(_\x8c_\x8l_\x8a_\x8s_\x8s_\x8·_\x8i_\x8n·······_\x8m_\x8e_\x8t_\x8h_\x8o_\x8d_\x8)1102 ····*·_\x8X_\x8m_\x8l_\x8I_\x8t_\x8e_\x8m_\x8E_\x8x_\x8p_\x8o_\x8r_\x8t_\x8e_\x8r_\x8·_\x8(_\x8c_\x8l_\x8a_\x8s_\x8s_\x8·_\x8i_\x8n·······_\x8m_\x8e_\x8t_\x8h_\x8o_\x8d_\x8)
1103 ······_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8e_\x8x_\x8p_\x8o_\x8r_\x8t_\x8e_\x8r_\x8s_\x8)···················o·_\x8(_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8e_\x8l_\x8e_\x8c_\x8t_\x8o_\x8r_\x8._\x8S_\x8e_\x8l_\x8e_\x8c_\x8t_\x8o_\x8r_\x8·_\x8m_\x8e_\x8t_\x8h_\x8o_\x8d_\x8)1103 ······_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8e_\x8x_\x8p_\x8o_\x8r_\x8t_\x8e_\x8r_\x8s_\x8)···················o·_\x8(_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8e_\x8l_\x8e_\x8c_\x8t_\x8o_\x8r_\x8._\x8S_\x8e_\x8l_\x8e_\x8c_\x8t_\x8o_\x8r_\x8·_\x8m_\x8e_\x8t_\x8h_\x8o_\x8d_\x8)
1104 ····*·_\x8x_\x8m_\x8l_\x8i_\x8t_\x8e_\x8r_\x8__\x8l_\x8x_\x8m_\x8l_\x8(_\x8)_\x8·_\x8(_\x8i_\x8n_\x8·_\x8m_\x8o_\x8d_\x8u_\x8l_\x8e···········o·_\x8(_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8e_\x8l_\x8e_\x8c_\x8t_\x8o_\x8r_\x8._\x8S_\x8e_\x8l_\x8e_\x8c_\x8t_\x8o_\x8r_\x8L_\x8i_\x8s_\x8t1104 ····*·_\x8x_\x8m_\x8l_\x8i_\x8t_\x8e_\x8r_\x8__\x8l_\x8x_\x8m_\x8l_\x8(_\x8)_\x8·_\x8(_\x8i_\x8n_\x8·_\x8m_\x8o_\x8d_\x8u_\x8l_\x8e···········o·_\x8(_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8e_\x8l_\x8e_\x8c_\x8t_\x8o_\x8r_\x8._\x8S_\x8e_\x8l_\x8e_\x8c_\x8t_\x8o_\x8r_\x8L_\x8i_\x8s_\x8t
1105 ······_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8i_\x8t_\x8e_\x8r_\x8a_\x8t_\x8o_\x8r_\x8s_\x8)···············_\x8m_\x8e_\x8t_\x8h_\x8o_\x8d_\x8)1105 ······_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8i_\x8t_\x8e_\x8r_\x8a_\x8t_\x8o_\x8r_\x8s_\x8)···············_\x8m_\x8e_\x8t_\x8h_\x8o_\x8d_\x8)
1106 ===============================================================================1106 ===============================================================================
1107 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.1107 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
1108 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.1108 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.45 KB
./usr/share/doc/python-scrapy-doc/html/index.html
    
Offset 314, 15 lines modifiedOffset 314, 15 lines modified
314 ········<a·href="intro/overview.html"·class="btn·btn-neutral·float-right"·title="Scrapy·at·a·glance"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>314 ········<a·href="intro/overview.html"·class="btn·btn-neutral·float-right"·title="Scrapy·at·a·glance"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
315 ····</div>315 ····</div>
  
316 ··<hr/>316 ··<hr/>
  
317 ··<div·role="contentinfo">317 ··<div·role="contentinfo">
318 ····<p>&#169;·Copyright·Scrapy·developers.318 ····<p>&#169;·Copyright·Scrapy·developers.
319 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.319 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
320 ······</span></p>320 ······</span></p>
321 ··</div>321 ··</div>
  
322 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a322 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
323 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>323 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
324 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.324 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
325 ···325 ···
⊟
693 B
html2text {}
    
Offset 173, 9 lines modifiedOffset 173, 9 lines modified
173 ······See·what·has·changed·in·recent·Scrapy·versions.173 ······See·what·has·changed·in·recent·Scrapy·versions.
174 ··_\x8C_\x8o_\x8n_\x8t_\x8r_\x8i_\x8b_\x8u_\x8t_\x8i_\x8n_\x8g_\x8·_\x8t_\x8o_\x8·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y174 ··_\x8C_\x8o_\x8n_\x8t_\x8r_\x8i_\x8b_\x8u_\x8t_\x8i_\x8n_\x8g_\x8·_\x8t_\x8o_\x8·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y
175 ······Learn·how·to·contribute·to·the·Scrapy·project.175 ······Learn·how·to·contribute·to·the·Scrapy·project.
176 ··_\x8V_\x8e_\x8r_\x8s_\x8i_\x8o_\x8n_\x8i_\x8n_\x8g_\x8·_\x8a_\x8n_\x8d_\x8·_\x8A_\x8P_\x8I_\x8·_\x8s_\x8t_\x8a_\x8b_\x8i_\x8l_\x8i_\x8t_\x8y176 ··_\x8V_\x8e_\x8r_\x8s_\x8i_\x8o_\x8n_\x8i_\x8n_\x8g_\x8·_\x8a_\x8n_\x8d_\x8·_\x8A_\x8P_\x8I_\x8·_\x8s_\x8t_\x8a_\x8b_\x8i_\x8l_\x8i_\x8t_\x8y
177 ······Understand·Scrapy·versioning·and·API·stability.177 ······Understand·Scrapy·versioning·and·API·stability.
178 _\x8N_\x8e_\x8x_\x8t178 _\x8N_\x8e_\x8x_\x8t
179 ===============================================================================179 ===============================================================================
180 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.180 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
181 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.181 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.55 KB
./usr/share/doc/python-scrapy-doc/html/intro/examples.html
    
Offset 169, 15 lines modifiedOffset 169, 15 lines modified
169 ········<a·href="../topics/commands.html"·class="btn·btn-neutral·float-right"·title="Command·line·tool"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>169 ········<a·href="../topics/commands.html"·class="btn·btn-neutral·float-right"·title="Command·line·tool"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
170 ····</div>170 ····</div>
  
171 ··<hr/>171 ··<hr/>
  
172 ··<div·role="contentinfo">172 ··<div·role="contentinfo">
173 ····<p>&#169;·Copyright·Scrapy·developers.173 ····<p>&#169;·Copyright·Scrapy·developers.
174 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.174 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
175 ······</span></p>175 ······</span></p>
176 ··</div>176 ··</div>
  
177 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a177 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
178 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>178 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
179 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.179 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
180 ···180 ···
⊟
775 B
html2text {}
    
Offset 66, 9 lines modifiedOffset 66, 9 lines modified
66 expressions.66 expressions.
67 The·_\x8q_\x8u_\x8o_\x8t_\x8e_\x8s_\x8b_\x8o_\x8t·project·is·available·at:·_\x8h_\x8t_\x8t_\x8p_\x8s_\x8:_\x8/_\x8/_\x8g_\x8i_\x8t_\x8h_\x8u_\x8b_\x8._\x8c_\x8o_\x8m_\x8/_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8/_\x8q_\x8u_\x8o_\x8t_\x8e_\x8s_\x8b_\x8o_\x8t.·You67 The·_\x8q_\x8u_\x8o_\x8t_\x8e_\x8s_\x8b_\x8o_\x8t·project·is·available·at:·_\x8h_\x8t_\x8t_\x8p_\x8s_\x8:_\x8/_\x8/_\x8g_\x8i_\x8t_\x8h_\x8u_\x8b_\x8._\x8c_\x8o_\x8m_\x8/_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8/_\x8q_\x8u_\x8o_\x8t_\x8e_\x8s_\x8b_\x8o_\x8t.·You
68 can·find·more·information·about·it·in·the·project’s·README.68 can·find·more·information·about·it·in·the·project’s·README.
69 If·you’re·familiar·with·git,·you·can·checkout·the·code.·Otherwise·you·can69 If·you’re·familiar·with·git,·you·can·checkout·the·code.·Otherwise·you·can
70 download·the·project·as·a·zip·file·by·clicking·_\x8h_\x8e_\x8r_\x8e.70 download·the·project·as·a·zip·file·by·clicking·_\x8h_\x8e_\x8r_\x8e.
71 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t71 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
72 ===============================================================================72 ===============================================================================
73 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.73 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
74 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.74 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.44 KB
./usr/share/doc/python-scrapy-doc/html/intro/install.html
    
Offset 397, 15 lines modifiedOffset 397, 15 lines modified
397 ········<a·href="tutorial.html"·class="btn·btn-neutral·float-right"·title="Scrapy·Tutorial"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>397 ········<a·href="tutorial.html"·class="btn·btn-neutral·float-right"·title="Scrapy·Tutorial"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
398 ····</div>398 ····</div>
  
399 ··<hr/>399 ··<hr/>
  
400 ··<div·role="contentinfo">400 ··<div·role="contentinfo">
401 ····<p>&#169;·Copyright·Scrapy·developers.401 ····<p>&#169;·Copyright·Scrapy·developers.
402 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.402 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
403 ······</span></p>403 ······</span></p>
404 ··</div>404 ··</div>
  
405 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a405 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
406 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>406 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
407 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.407 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
408 ···408 ···
⊟
670 B
html2text {}
    
Offset 219, 9 lines modifiedOffset 219, 9 lines modified
219 has·a·version·of·pyOpenSSL·that·your·version·of·Twisted·does·not·support.219 has·a·version·of·pyOpenSSL·that·your·version·of·Twisted·does·not·support.
220 To·install·a·version·of·pyOpenSSL·that·your·version·of·Twisted·supports,220 To·install·a·version·of·pyOpenSSL·that·your·version·of·Twisted·supports,
221 reinstall·Twisted·with·the·tls·extra·option:221 reinstall·Twisted·with·the·tls·extra·option:
222 pip·install·twisted[tls]222 pip·install·twisted[tls]
223 For·details,·see·_\x8I_\x8s_\x8s_\x8u_\x8e_\x8·_\x8#_\x82_\x84_\x87_\x83.223 For·details,·see·_\x8I_\x8s_\x8s_\x8u_\x8e_\x8·_\x8#_\x82_\x84_\x87_\x83.
224 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t224 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
225 ===============================================================================225 ===============================================================================
226 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.226 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
227 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.227 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.57 KB
./usr/share/doc/python-scrapy-doc/html/intro/overview.html
    
Offset 291, 15 lines modifiedOffset 291, 15 lines modified
291 ········<a·href="install.html"·class="btn·btn-neutral·float-right"·title="Installation·guide"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>291 ········<a·href="install.html"·class="btn·btn-neutral·float-right"·title="Installation·guide"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
292 ····</div>292 ····</div>
  
293 ··<hr/>293 ··<hr/>
  
294 ··<div·role="contentinfo">294 ··<div·role="contentinfo">
295 ····<p>&#169;·Copyright·Scrapy·developers.295 ····<p>&#169;·Copyright·Scrapy·developers.
296 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.296 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
297 ······</span></p>297 ······</span></p>
298 ··</div>298 ··</div>
  
299 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a299 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
300 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>300 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
301 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.301 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
302 ···302 ···
⊟
797 B
html2text {}
    
Offset 166, 9 lines modifiedOffset 166, 9 lines modified
166 ······resolver,·and·much·more!166 ······resolver,·and·much·more!
167 *\x8**\x8**\x8**\x8**\x8*·W\x8Wh\x8ha\x8at\x8t?\x8’s\x8s·n\x8ne\x8ex\x8xt\x8t?\x8?_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*167 *\x8**\x8**\x8**\x8**\x8*·W\x8Wh\x8ha\x8at\x8t?\x8’s\x8s·n\x8ne\x8ex\x8xt\x8t?\x8?_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*
168 The·next·steps·for·you·are·to·_\x8i_\x8n_\x8s_\x8t_\x8a_\x8l_\x8l_\x8·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y,·_\x8f_\x8o_\x8l_\x8l_\x8o_\x8w_\x8·_\x8t_\x8h_\x8r_\x8o_\x8u_\x8g_\x8h_\x8·_\x8t_\x8h_\x8e_\x8·_\x8t_\x8u_\x8t_\x8o_\x8r_\x8i_\x8a_\x8l·to168 The·next·steps·for·you·are·to·_\x8i_\x8n_\x8s_\x8t_\x8a_\x8l_\x8l_\x8·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y,·_\x8f_\x8o_\x8l_\x8l_\x8o_\x8w_\x8·_\x8t_\x8h_\x8r_\x8o_\x8u_\x8g_\x8h_\x8·_\x8t_\x8h_\x8e_\x8·_\x8t_\x8u_\x8t_\x8o_\x8r_\x8i_\x8a_\x8l·to
169 learn·how·to·create·a·full-blown·Scrapy·project·and·_\x8j_\x8o_\x8i_\x8n_\x8·_\x8t_\x8h_\x8e_\x8·_\x8c_\x8o_\x8m_\x8m_\x8u_\x8n_\x8i_\x8t_\x8y.·Thanks169 learn·how·to·create·a·full-blown·Scrapy·project·and·_\x8j_\x8o_\x8i_\x8n_\x8·_\x8t_\x8h_\x8e_\x8·_\x8c_\x8o_\x8m_\x8m_\x8u_\x8n_\x8i_\x8t_\x8y.·Thanks
170 for·your·interest!170 for·your·interest!
171 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t171 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
172 ===============================================================================172 ===============================================================================
173 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.173 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
174 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.174 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.54 KB
./usr/share/doc/python-scrapy-doc/html/intro/tutorial.html
    
Offset 863, 15 lines modifiedOffset 863, 15 lines modified
863 ········<a·href="examples.html"·class="btn·btn-neutral·float-right"·title="Examples"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>863 ········<a·href="examples.html"·class="btn·btn-neutral·float-right"·title="Examples"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
864 ····</div>864 ····</div>
  
865 ··<hr/>865 ··<hr/>
  
866 ··<div·role="contentinfo">866 ··<div·role="contentinfo">
867 ····<p>&#169;·Copyright·Scrapy·developers.867 ····<p>&#169;·Copyright·Scrapy·developers.
868 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.868 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
869 ······</span></p>869 ······</span></p>
870 ··</div>870 ··</div>
  
871 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a871 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
872 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>872 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
873 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.873 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
874 ···874 ···
⊟
785 B
html2text {}
    
Offset 630, 9 lines modifiedOffset 630, 9 lines modified
630 _\x8g_\x8l_\x8a_\x8n_\x8c_\x8e·chapter·for·a·quick·overview·of·the·most·important·ones.630 _\x8g_\x8l_\x8a_\x8n_\x8c_\x8e·chapter·for·a·quick·overview·of·the·most·important·ones.
631 You·can·continue·from·the·section·_\x8B_\x8a_\x8s_\x8i_\x8c_\x8·_\x8c_\x8o_\x8n_\x8c_\x8e_\x8p_\x8t_\x8s·to·know·more·about·the631 You·can·continue·from·the·section·_\x8B_\x8a_\x8s_\x8i_\x8c_\x8·_\x8c_\x8o_\x8n_\x8c_\x8e_\x8p_\x8t_\x8s·to·know·more·about·the
632 command-line·tool,·spiders,·selectors·and·other·things·the·tutorial·hasn’t632 command-line·tool,·spiders,·selectors·and·other·things·the·tutorial·hasn’t
633 covered·like·modeling·the·scraped·data.·If·you’d·prefer·to·play·with·an·example633 covered·like·modeling·the·scraped·data.·If·you’d·prefer·to·play·with·an·example
634 project,·check·the·_\x8E_\x8x_\x8a_\x8m_\x8p_\x8l_\x8e_\x8s·section.634 project,·check·the·_\x8E_\x8x_\x8a_\x8m_\x8p_\x8l_\x8e_\x8s·section.
635 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t635 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
636 ===============================================================================636 ===============================================================================
637 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.637 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
638 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.638 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.5 KB
./usr/share/doc/python-scrapy-doc/html/news.html
    
Offset 6619, 15 lines modifiedOffset 6619, 15 lines modified
6619 ········<a·href="contributing.html"·class="btn·btn-neutral·float-right"·title="Contributing·to·Scrapy"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>6619 ········<a·href="contributing.html"·class="btn·btn-neutral·float-right"·title="Contributing·to·Scrapy"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
6620 ····</div>6620 ····</div>
  
6621 ··<hr/>6621 ··<hr/>
  
6622 ··<div·role="contentinfo">6622 ··<div·role="contentinfo">
6623 ····<p>&#169;·Copyright·Scrapy·developers.6623 ····<p>&#169;·Copyright·Scrapy·developers.
6624 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.6624 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
6625 ······</span></p>6625 ······</span></p>
6626 ··</div>6626 ··</div>
  
6627 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a6627 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
6628 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>6628 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
6629 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.6629 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
6630 ···6630 ···
⊟
734 B
html2text {}
    
Offset 4659, 9 lines modifiedOffset 4659, 9 lines modified
4659 ····*·Renamed·extension:·DelayedCloseDomain·to·SpiderCloseDelay·(_\x8r_\x81_\x88_\x86_\x81·|·#121)4659 ····*·Renamed·extension:·DelayedCloseDomain·to·SpiderCloseDelay·(_\x8r_\x81_\x88_\x86_\x81·|·#121)
4660 ····*·Removed·obsolete·scrapy.utils.markup.remove_escape_chars·function·-·use4660 ····*·Removed·obsolete·scrapy.utils.markup.remove_escape_chars·function·-·use
4661 ······scrapy.utils.markup.replace_escape_chars·instead·(_\x8r_\x81_\x88_\x86_\x85)4661 ······scrapy.utils.markup.replace_escape_chars·instead·(_\x8r_\x81_\x88_\x86_\x85)
4662 *\x8**\x8**\x8**\x8**\x8*·S\x8Sc\x8cr\x8ra\x8ap\x8py\x8y·0\x80.\x8.7\x87_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*4662 *\x8**\x8**\x8**\x8**\x8*·S\x8Sc\x8cr\x8ra\x8ap\x8py\x8y·0\x80.\x8.7\x87_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*
4663 First·release·of·Scrapy.4663 First·release·of·Scrapy.
4664 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t4664 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
4665 ===============================================================================4665 ===============================================================================
4666 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.4666 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
4667 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.4667 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.82 KB
./usr/share/doc/python-scrapy-doc/html/py-modindex.html
    
Offset 445, 15 lines modifiedOffset 445, 15 lines modified
445 ··········</div>445 ··········</div>
446 ··········<footer>446 ··········<footer>
  
447 ··<hr/>447 ··<hr/>
  
448 ··<div·role="contentinfo">448 ··<div·role="contentinfo">
449 ····<p>&#169;·Copyright·Scrapy·developers.449 ····<p>&#169;·Copyright·Scrapy·developers.
450 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.450 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
451 ······</span></p>451 ······</span></p>
452 ··</div>452 ··</div>
  
453 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a453 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
454 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>454 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
455 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.455 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
456 ···456 ···
⊟
1.2 KB
html2text {}
    
Offset 123, 9 lines modifiedOffset 123, 9 lines modified
123 ····   ·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8p_\x8i_\x8d_\x8e_\x8r_\x8m_\x8i_\x8d_\x8d_\x8l_\x8e_\x8w_\x8a_\x8r_\x8e_\x8s_\x8._\x8r_\x8e_\x8f_\x8e_\x8r_\x8e_\x8r·········R\x8Re\x8ef\x8fe\x8er\x8re\x8er\x8r·S\x8Sp\x8pi\x8id\x8de\x8er\x8r·M\x8Mi\x8id\x8dd\x8dl\x8le\x8ew\x8wa\x8ar\x8re\x8e123 ····   ·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8p_\x8i_\x8d_\x8e_\x8r_\x8m_\x8i_\x8d_\x8d_\x8l_\x8e_\x8w_\x8a_\x8r_\x8e_\x8s_\x8._\x8r_\x8e_\x8f_\x8e_\x8r_\x8e_\x8r·········R\x8Re\x8ef\x8fe\x8er\x8re\x8er\x8r·S\x8Sp\x8pi\x8id\x8de\x8er\x8r·M\x8Mi\x8id\x8dd\x8dl\x8le\x8ew\x8wa\x8ar\x8re\x8e
124 ····   ·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8p_\x8i_\x8d_\x8e_\x8r_\x8m_\x8i_\x8d_\x8d_\x8l_\x8e_\x8w_\x8a_\x8r_\x8e_\x8s_\x8._\x8u_\x8r_\x8l_\x8l_\x8e_\x8n_\x8g_\x8t_\x8h·······U\x8UR\x8RL\x8L·L\x8Le\x8en\x8ng\x8gt\x8th\x8h·S\x8Sp\x8pi\x8id\x8de\x8er\x8r·M\x8Mi\x8id\x8dd\x8dl\x8le\x8ew\x8wa\x8ar\x8re\x8e124 ····   ·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8p_\x8i_\x8d_\x8e_\x8r_\x8m_\x8i_\x8d_\x8d_\x8l_\x8e_\x8w_\x8a_\x8r_\x8e_\x8s_\x8._\x8u_\x8r_\x8l_\x8l_\x8e_\x8n_\x8g_\x8t_\x8h·······U\x8UR\x8RL\x8L·L\x8Le\x8en\x8ng\x8gt\x8th\x8h·S\x8Sp\x8pi\x8id\x8de\x8er\x8r·M\x8Mi\x8id\x8dd\x8dl\x8le\x8ew\x8wa\x8ar\x8re\x8e
125 ····   ·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8t_\x8a_\x8t_\x8s_\x8c_\x8o_\x8l_\x8l_\x8e_\x8c_\x8t_\x8o_\x8r_\x8s···················S\x8St\x8ta\x8at\x8ts\x8s·C\x8Co\x8ol\x8ll\x8le\x8ec\x8ct\x8to\x8or\x8rs\x8s125 ····   ·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8s_\x8t_\x8a_\x8t_\x8s_\x8c_\x8o_\x8l_\x8l_\x8e_\x8c_\x8t_\x8o_\x8r_\x8s···················S\x8St\x8ta\x8at\x8ts\x8s·C\x8Co\x8ol\x8ll\x8le\x8ec\x8ct\x8to\x8or\x8rs\x8s
126 ····   ·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8l_\x8o_\x8g·························L\x8Lo\x8og\x8gg\x8gi\x8in\x8ng\x8g·u\x8ut\x8ti\x8il\x8ls\x8s126 ····   ·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8l_\x8o_\x8g·························L\x8Lo\x8og\x8gg\x8gi\x8in\x8ng\x8g·u\x8ut\x8ti\x8il\x8ls\x8s
127 ····   ·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8t_\x8r_\x8a_\x8c_\x8k_\x8r_\x8e_\x8f····················T\x8Tr\x8ra\x8ac\x8ck\x8k·r\x8re\x8ef\x8fe\x8er\x8re\x8en\x8nc\x8ce\x8es\x8s·o\x8of\x8f·l\x8li\x8iv\x8ve\x8e127 ····   ·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8._\x8u_\x8t_\x8i_\x8l_\x8s_\x8._\x8t_\x8r_\x8a_\x8c_\x8k_\x8r_\x8e_\x8f····················T\x8Tr\x8ra\x8ac\x8ck\x8k·r\x8re\x8ef\x8fe\x8er\x8re\x8en\x8nc\x8ce\x8es\x8s·o\x8of\x8f·l\x8li\x8iv\x8ve\x8e
128 ·················································o\x8ob\x8bj\x8je\x8ec\x8ct\x8ts\x8s128 ·················································o\x8ob\x8bj\x8je\x8ec\x8ct\x8ts\x8s
129 ===============================================================================129 ===============================================================================
130 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.130 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
131 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.131 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.29 KB
./usr/share/doc/python-scrapy-doc/html/search.html
    
Offset 163, 15 lines modifiedOffset 163, 15 lines modified
163 ··········</div>163 ··········</div>
164 ··········<footer>164 ··········<footer>
  
165 ··<hr/>165 ··<hr/>
  
166 ··<div·role="contentinfo">166 ··<div·role="contentinfo">
167 ····<p>&#169;·Copyright·Scrapy·developers.167 ····<p>&#169;·Copyright·Scrapy·developers.
168 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.168 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
169 ······</span></p>169 ······</span></p>
170 ··</div>170 ··</div>
  
171 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a171 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
172 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>172 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
173 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.173 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
174 ···174 ···
⊟
700 B
html2text {}
    
Offset 55, 9 lines modifiedOffset 55, 9 lines modified
55 ····*·_\x8C_\x8o_\x8n_\x8t_\x8r_\x8i_\x8b_\x8u_\x8t_\x8i_\x8n_\x8g_\x8·_\x8t_\x8o_\x8·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y55 ····*·_\x8C_\x8o_\x8n_\x8t_\x8r_\x8i_\x8b_\x8u_\x8t_\x8i_\x8n_\x8g_\x8·_\x8t_\x8o_\x8·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y
56 ····*·_\x8V_\x8e_\x8r_\x8s_\x8i_\x8o_\x8n_\x8i_\x8n_\x8g_\x8·_\x8a_\x8n_\x8d_\x8·_\x8A_\x8P_\x8I_\x8·_\x8s_\x8t_\x8a_\x8b_\x8i_\x8l_\x8i_\x8t_\x8y56 ····*·_\x8V_\x8e_\x8r_\x8s_\x8i_\x8o_\x8n_\x8i_\x8n_\x8g_\x8·_\x8a_\x8n_\x8d_\x8·_\x8A_\x8P_\x8I_\x8·_\x8s_\x8t_\x8a_\x8b_\x8i_\x8l_\x8i_\x8t_\x8y
57 _\x8S_\x8c_\x8r_\x8a_\x8p_\x8y57 _\x8S_\x8c_\x8r_\x8a_\x8p_\x8y
58 ····*·Search58 ····*·Search
59 ===============================================================================59 ===============================================================================
60 Please·activate·JavaScript·to·enable·the·search·functionality.60 Please·activate·JavaScript·to·enable·the·search·functionality.
61 ===============================================================================61 ===============================================================================
62 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.62 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
63 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.63 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.39 KB
./usr/share/doc/python-scrapy-doc/html/topics/addons.html
    
Offset 342, 15 lines modifiedOffset 342, 15 lines modified
342 ········<a·href="downloader-middleware.html"·class="btn·btn-neutral·float-right"·title="Downloader·Middleware"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>342 ········<a·href="downloader-middleware.html"·class="btn·btn-neutral·float-right"·title="Downloader·Middleware"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
343 ····</div>343 ····</div>
  
344 ··<hr/>344 ··<hr/>
  
345 ··<div·role="contentinfo">345 ··<div·role="contentinfo">
346 ····<p>&#169;·Copyright·Scrapy·developers.346 ····<p>&#169;·Copyright·Scrapy·developers.
347 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.347 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
348 ······</span></p>348 ······</span></p>
349 ··</div>349 ··</div>
  
350 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a350 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
351 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>351 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
352 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.352 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
353 ···353 ···
⊟
601 B
html2text {}
    
Offset 196, 9 lines modifiedOffset 196, 9 lines modified
196 ················FALLBACK_SETTING,196 ················FALLBACK_SETTING,
197 ················settings.getwithbase("DOWNLOAD_HANDLERS")["https"],197 ················settings.getwithbase("DOWNLOAD_HANDLERS")["https"],
198 ················"addon",198 ················"addon",
199 ············)199 ············)
200 ········settings["DOWNLOAD_HANDLERS"]["https"]·=·MyHandler200 ········settings["DOWNLOAD_HANDLERS"]["https"]·=·MyHandler
201 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t201 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
202 ===============================================================================202 ===============================================================================
203 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.203 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
204 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.204 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.47 KB
./usr/share/doc/python-scrapy-doc/html/topics/api.html
    
Offset 1128, 15 lines modifiedOffset 1128, 15 lines modified
1128 ········<a·href="../news.html"·class="btn·btn-neutral·float-right"·title="Release·notes"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>1128 ········<a·href="../news.html"·class="btn·btn-neutral·float-right"·title="Release·notes"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
1129 ····</div>1129 ····</div>
  
1130 ··<hr/>1130 ··<hr/>
  
1131 ··<div·role="contentinfo">1131 ··<div·role="contentinfo">
1132 ····<p>&#169;·Copyright·Scrapy·developers.1132 ····<p>&#169;·Copyright·Scrapy·developers.
1133 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.1133 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
1134 ······</span></p>1134 ······</span></p>
1135 ··</div>1135 ··</div>
  
1136 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a1136 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
1137 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>1137 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
1138 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.1138 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
1139 ···1139 ···
⊟
715 B
html2text {}
    
Offset 615, 9 lines modifiedOffset 615, 9 lines modified
615 ········open_spider(s\x8sp\x8pi\x8id\x8de\x8er\x8r)_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x8615 ········open_spider(s\x8sp\x8pi\x8id\x8de\x8er\x8r)_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x8
616 ············Open·the·given·spider·for·stats·collection.616 ············Open·the·given·spider·for·stats·collection.
617 ········close_spider(s\x8sp\x8pi\x8id\x8de\x8er\x8r)_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x8617 ········close_spider(s\x8sp\x8pi\x8id\x8de\x8er\x8r)_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x8
618 ············Close·the·given·spider.·After·this·is·called,·no·more·specific618 ············Close·the·given·spider.·After·this·is·called,·no·more·specific
619 ············stats·can·be·accessed·or·collected.619 ············stats·can·be·accessed·or·collected.
620 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t620 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
621 ===============================================================================621 ===============================================================================
622 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.622 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
623 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.623 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.44 KB
./usr/share/doc/python-scrapy-doc/html/topics/architecture.html
    
Offset 301, 15 lines modifiedOffset 301, 15 lines modified
301 ········<a·href="addons.html"·class="btn·btn-neutral·float-right"·title="Add-ons"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>301 ········<a·href="addons.html"·class="btn·btn-neutral·float-right"·title="Add-ons"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
302 ····</div>302 ····</div>
  
303 ··<hr/>303 ··<hr/>
  
304 ··<div·role="contentinfo">304 ··<div·role="contentinfo">
305 ····<p>&#169;·Copyright·Scrapy·developers.305 ····<p>&#169;·Copyright·Scrapy·developers.
306 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.306 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
307 ······</span></p>307 ······</span></p>
308 ··</div>308 ··</div>
  
309 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a309 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
310 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>310 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
311 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.311 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
312 ···312 ···
⊟
671 B
html2text {}
    
Offset 151, 9 lines modifiedOffset 151, 9 lines modified
151 concurrency.151 concurrency.
152 For·more·information·about·asynchronous·programming·and·Twisted·see·these152 For·more·information·about·asynchronous·programming·and·Twisted·see·these
153 links:153 links:
154 ····*·_\x8I_\x8n_\x8t_\x8r_\x8o_\x8d_\x8u_\x8c_\x8t_\x8i_\x8o_\x8n_\x8·_\x8t_\x8o_\x8·_\x8D_\x8e_\x8f_\x8e_\x8r_\x8r_\x8e_\x8d_\x8s154 ····*·_\x8I_\x8n_\x8t_\x8r_\x8o_\x8d_\x8u_\x8c_\x8t_\x8i_\x8o_\x8n_\x8·_\x8t_\x8o_\x8·_\x8D_\x8e_\x8f_\x8e_\x8r_\x8r_\x8e_\x8d_\x8s
155 ····*·_\x8T_\x8w_\x8i_\x8s_\x8t_\x8e_\x8d_\x8·_\x8I_\x8n_\x8t_\x8r_\x8o_\x8d_\x8u_\x8c_\x8t_\x8i_\x8o_\x8n_\x8·_\x8-_\x8·_\x8K_\x8r_\x8o_\x8n_\x8d_\x8o155 ····*·_\x8T_\x8w_\x8i_\x8s_\x8t_\x8e_\x8d_\x8·_\x8I_\x8n_\x8t_\x8r_\x8o_\x8d_\x8u_\x8c_\x8t_\x8i_\x8o_\x8n_\x8·_\x8-_\x8·_\x8K_\x8r_\x8o_\x8n_\x8d_\x8o
156 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t156 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
157 ===============================================================================157 ===============================================================================
158 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.158 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
159 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.159 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.55 KB
./usr/share/doc/python-scrapy-doc/html/topics/asyncio.html
    
Offset 329, 15 lines modifiedOffset 329, 15 lines modified
329 ········<a·href="architecture.html"·class="btn·btn-neutral·float-right"·title="Architecture·overview"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>329 ········<a·href="architecture.html"·class="btn·btn-neutral·float-right"·title="Architecture·overview"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
330 ····</div>330 ····</div>
  
331 ··<hr/>331 ··<hr/>
  
332 ··<div·role="contentinfo">332 ··<div·role="contentinfo">
333 ····<p>&#169;·Copyright·Scrapy·developers.333 ····<p>&#169;·Copyright·Scrapy·developers.
334 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.334 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
335 ······</span></p>335 ······</span></p>
336 ··</div>336 ··</div>
  
337 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a337 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
338 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>338 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
339 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.339 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
340 ···340 ···
⊟
771 B
html2text {}
    
Offset 171, 9 lines modifiedOffset 171, 9 lines modified
171 native·Linux).171 native·Linux).
172 *\x8**\x8**\x8**\x8**\x8*·U\x8Us\x8si\x8in\x8ng\x8g·c\x8cu\x8us\x8st\x8to\x8om\x8m·a\x8as\x8sy\x8yn\x8nc\x8ci\x8io\x8o·l\x8lo\x8oo\x8op\x8ps\x8s_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*172 *\x8**\x8**\x8**\x8**\x8*·U\x8Us\x8si\x8in\x8ng\x8g·c\x8cu\x8us\x8st\x8to\x8om\x8m·a\x8as\x8sy\x8yn\x8nc\x8ci\x8io\x8o·l\x8lo\x8oo\x8op\x8ps\x8s_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*
173 You·can·also·use·custom·asyncio·event·loops·with·the·asyncio·reactor.·Set·the173 You·can·also·use·custom·asyncio·event·loops·with·the·asyncio·reactor.·Set·the
174 _\x8A_\x8S_\x8Y_\x8N_\x8C_\x8I_\x8O_\x8__\x8E_\x8V_\x8E_\x8N_\x8T_\x8__\x8L_\x8O_\x8O_\x8P·setting·to·the·import·path·of·the·desired·event·loop·class174 _\x8A_\x8S_\x8Y_\x8N_\x8C_\x8I_\x8O_\x8__\x8E_\x8V_\x8E_\x8N_\x8T_\x8__\x8L_\x8O_\x8O_\x8P·setting·to·the·import·path·of·the·desired·event·loop·class
175 to·use·it·instead·of·the·default·asyncio·event·loop.175 to·use·it·instead·of·the·default·asyncio·event·loop.
176 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t176 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
177 ===============================================================================177 ===============================================================================
178 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.178 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
179 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.179 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.44 KB
./usr/share/doc/python-scrapy-doc/html/topics/autothrottle.html
    
Offset 325, 15 lines modifiedOffset 325, 15 lines modified
325 ········<a·href="benchmarking.html"·class="btn·btn-neutral·float-right"·title="Benchmarking"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>325 ········<a·href="benchmarking.html"·class="btn·btn-neutral·float-right"·title="Benchmarking"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
326 ····</div>326 ····</div>
  
327 ··<hr/>327 ··<hr/>
  
328 ··<div·role="contentinfo">328 ··<div·role="contentinfo">
329 ····<p>&#169;·Copyright·Scrapy·developers.329 ····<p>&#169;·Copyright·Scrapy·developers.
330 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.330 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
331 ······</span></p>331 ······</span></p>
332 ··</div>332 ··</div>
  
333 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a333 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
334 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>334 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
335 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.335 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
336 ···336 ···
⊟
664 B
html2text {}
    
Offset 181, 9 lines modifiedOffset 181, 9 lines modified
181 *\x8**\x8**\x8**\x8*·A\x8AU\x8UT\x8TO\x8OT\x8TH\x8HR\x8RO\x8OT\x8TT\x8TL\x8LE\x8E_\x8_D\x8DE\x8EB\x8BU\x8UG\x8G_\x8?\x8·*\x8**\x8**\x8**\x8*181 *\x8**\x8**\x8**\x8*·A\x8AU\x8UT\x8TO\x8OT\x8TH\x8HR\x8RO\x8OT\x8TT\x8TL\x8LE\x8E_\x8_D\x8DE\x8EB\x8BU\x8UG\x8G_\x8?\x8·*\x8**\x8**\x8**\x8*
182 Default:·False182 Default:·False
183 Enable·AutoThrottle·debug·mode·which·will·display·stats·on·every·response183 Enable·AutoThrottle·debug·mode·which·will·display·stats·on·every·response
184 received,·so·you·can·see·how·the·throttling·parameters·are·being·adjusted·in184 received,·so·you·can·see·how·the·throttling·parameters·are·being·adjusted·in
185 real·time.185 real·time.
186 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t186 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
187 ===============================================================================187 ===============================================================================
188 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.188 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
189 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.189 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.52 KB
./usr/share/doc/python-scrapy-doc/html/topics/benchmarking.html
    
Offset 235, 15 lines modifiedOffset 235, 15 lines modified
235 ········<a·href="jobs.html"·class="btn·btn-neutral·float-right"·title="Jobs:·pausing·and·resuming·crawls"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>235 ········<a·href="jobs.html"·class="btn·btn-neutral·float-right"·title="Jobs:·pausing·and·resuming·crawls"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
236 ····</div>236 ····</div>
  
237 ··<hr/>237 ··<hr/>
  
238 ··<div·role="contentinfo">238 ··<div·role="contentinfo">
239 ····<p>&#169;·Copyright·Scrapy·developers.239 ····<p>&#169;·Copyright·Scrapy·developers.
240 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.240 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
241 ······</span></p>241 ······</span></p>
242 ··</div>242 ··</div>
  
243 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a243 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
244 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>244 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
245 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.245 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
246 ···246 ···
⊟
733 B
html2text {}
    
Offset 146, 9 lines modifiedOffset 146, 9 lines modified
146 hardware·where·you·run·it.·Note·that·this·is·a·very·simple·spider·intended·to146 hardware·where·you·run·it.·Note·that·this·is·a·very·simple·spider·intended·to
147 follow·links,·any·custom·spider·you·write·will·probably·do·more·stuff·which147 follow·links,·any·custom·spider·you·write·will·probably·do·more·stuff·which
148 results·in·slower·crawl·rates.·How·slower·depends·on·how·much·your·spider·does148 results·in·slower·crawl·rates.·How·slower·depends·on·how·much·your·spider·does
149 and·how·well·it’s·written.149 and·how·well·it’s·written.
150 Use·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8-_\x8b_\x8e_\x8n_\x8c_\x8h·for·more·complex·benchmarking.150 Use·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8-_\x8b_\x8e_\x8n_\x8c_\x8h·for·more·complex·benchmarking.
151 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t151 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
152 ===============================================================================152 ===============================================================================
153 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.153 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
154 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.154 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.79 KB
./usr/share/doc/python-scrapy-doc/html/topics/broad-crawls.html
    
Offset 353, 15 lines modifiedOffset 353, 15 lines modified
353 ········<a·href="developer-tools.html"·class="btn·btn-neutral·float-right"·title="Using·your·browser’s·Developer·Tools·for·scraping"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>353 ········<a·href="developer-tools.html"·class="btn·btn-neutral·float-right"·title="Using·your·browser’s·Developer·Tools·for·scraping"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
354 ····</div>354 ····</div>
  
355 ··<hr/>355 ··<hr/>
  
356 ··<div·role="contentinfo">356 ··<div·role="contentinfo">
357 ····<p>&#169;·Copyright·Scrapy·developers.357 ····<p>&#169;·Copyright·Scrapy·developers.
358 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.358 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
359 ······</span></p>359 ······</span></p>
360 ··</div>360 ··</div>
  
361 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a361 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
362 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>362 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
363 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.363 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
364 ···364 ···
⊟
981 B
html2text {}
    
Offset 199, 9 lines modifiedOffset 199, 9 lines modified
199 If·your·broad·crawl·shows·a·high·memory·usage,·in·addition·to·_\x8c_\x8r_\x8a_\x8w_\x8l_\x8i_\x8n_\x8g_\x8·_\x8i_\x8n_\x8·_\x8B_\x8F_\x8O199 If·your·broad·crawl·shows·a·high·memory·usage,·in·addition·to·_\x8c_\x8r_\x8a_\x8w_\x8l_\x8i_\x8n_\x8g_\x8·_\x8i_\x8n_\x8·_\x8B_\x8F_\x8O
200 _\x8o_\x8r_\x8d_\x8e_\x8r·and·_\x8l_\x8o_\x8w_\x8e_\x8r_\x8i_\x8n_\x8g_\x8·_\x8c_\x8o_\x8n_\x8c_\x8u_\x8r_\x8r_\x8e_\x8n_\x8c_\x8y·you·should·_\x8d_\x8e_\x8b_\x8u_\x8g_\x8·_\x8y_\x8o_\x8u_\x8r_\x8·_\x8m_\x8e_\x8m_\x8o_\x8r_\x8y_\x8·_\x8l_\x8e_\x8a_\x8k_\x8s.200 _\x8o_\x8r_\x8d_\x8e_\x8r·and·_\x8l_\x8o_\x8w_\x8e_\x8r_\x8i_\x8n_\x8g_\x8·_\x8c_\x8o_\x8n_\x8c_\x8u_\x8r_\x8r_\x8e_\x8n_\x8c_\x8y·you·should·_\x8d_\x8e_\x8b_\x8u_\x8g_\x8·_\x8y_\x8o_\x8u_\x8r_\x8·_\x8m_\x8e_\x8m_\x8o_\x8r_\x8y_\x8·_\x8l_\x8e_\x8a_\x8k_\x8s.
201 *\x8**\x8**\x8**\x8**\x8*·I\x8In\x8ns\x8st\x8ta\x8al\x8ll\x8l·a\x8a·s\x8sp\x8pe\x8ec\x8ci\x8if\x8fi\x8ic\x8c·T\x8Tw\x8wi\x8is\x8st\x8te\x8ed\x8d·r\x8re\x8ea\x8ac\x8ct\x8to\x8or\x8r_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*201 *\x8**\x8**\x8**\x8**\x8*·I\x8In\x8ns\x8st\x8ta\x8al\x8ll\x8l·a\x8a·s\x8sp\x8pe\x8ec\x8ci\x8if\x8fi\x8ic\x8c·T\x8Tw\x8wi\x8is\x8st\x8te\x8ed\x8d·r\x8re\x8ea\x8ac\x8ct\x8to\x8or\x8r_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*
202 If·the·crawl·is·exceeding·the·system’s·capabilities,·you·might·want·to·try202 If·the·crawl·is·exceeding·the·system’s·capabilities,·you·might·want·to·try
203 installing·a·specific·Twisted·reactor,·via·the·_\x8T_\x8W_\x8I_\x8S_\x8T_\x8E_\x8D_\x8__\x8R_\x8E_\x8A_\x8C_\x8T_\x8O_\x8R·setting.203 installing·a·specific·Twisted·reactor,·via·the·_\x8T_\x8W_\x8I_\x8S_\x8T_\x8E_\x8D_\x8__\x8R_\x8E_\x8A_\x8C_\x8T_\x8O_\x8R·setting.
204 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t204 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
205 ===============================================================================205 ===============================================================================
206 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.206 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
207 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.207 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.28 KB
./usr/share/doc/python-scrapy-doc/html/topics/commands.html
    
Offset 720, 15 lines modifiedOffset 720, 15 lines modified
720 ········<a·href="spiders.html"·class="btn·btn-neutral·float-right"·title="Spiders"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>720 ········<a·href="spiders.html"·class="btn·btn-neutral·float-right"·title="Spiders"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
721 ····</div>721 ····</div>
  
722 ··<hr/>722 ··<hr/>
  
723 ··<div·role="contentinfo">723 ··<div·role="contentinfo">
724 ····<p>&#169;·Copyright·Scrapy·developers.724 ····<p>&#169;·Copyright·Scrapy·developers.
725 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.725 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
726 ······</span></p>726 ······</span></p>
727 ··</div>727 ··</div>
  
728 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a728 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
729 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>729 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
730 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.730 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
731 ···731 ···
⊟
512 B
html2text {}
    
Offset 480, 9 lines modifiedOffset 480, 9 lines modified
480 ········"scrapy.commands":·[480 ········"scrapy.commands":·[
481 ············"my_command=my_scrapy_module.commands:MyCommand",481 ············"my_command=my_scrapy_module.commands:MyCommand",
482 ········],482 ········],
483 ····},483 ····},
484 )484 )
485 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t485 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
486 ===============================================================================486 ===============================================================================
487 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.487 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
488 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.488 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.44 KB
./usr/share/doc/python-scrapy-doc/html/topics/components.html
    
Offset 252, 15 lines modifiedOffset 252, 15 lines modified
252 ········<a·href="api.html"·class="btn·btn-neutral·float-right"·title="Core·API"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>252 ········<a·href="api.html"·class="btn·btn-neutral·float-right"·title="Core·API"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
253 ····</div>253 ····</div>
  
254 ··<hr/>254 ··<hr/>
  
255 ··<div·role="contentinfo">255 ··<div·role="contentinfo">
256 ····<p>&#169;·Copyright·Scrapy·developers.256 ····<p>&#169;·Copyright·Scrapy·developers.
257 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.257 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
258 ······</span></p>258 ······</span></p>
259 ··</div>259 ··</div>
  
260 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a260 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
261 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>261 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
262 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.262 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
263 ···263 ···
⊟
676 B
html2text {}
    
Offset 126, 9 lines modifiedOffset 126, 9 lines modified
126 ··scrapy.utils.python.global_object_name(o\x8ob\x8bj\x8j:\x8:·_\x8A\x8A_\x8n\x8n_\x8y\x8y)·→·_\x8s_\x8t_\x8r_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x8126 ··scrapy.utils.python.global_object_name(o\x8ob\x8bj\x8j:\x8:·_\x8A\x8A_\x8n\x8n_\x8y\x8y)·→·_\x8s_\x8t_\x8r_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x8
127 ······Return·the·full·import·path·of·the·given·class.127 ······Return·the·full·import·path·of·the·given·class.
128 ······>>>·from·scrapy·import·Request128 ······>>>·from·scrapy·import·Request
129 ······>>>·global_object_name(Request)129 ······>>>·global_object_name(Request)
130 ······'scrapy.http.request.Request'130 ······'scrapy.http.request.Request'
131 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t131 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
132 ===============================================================================132 ===============================================================================
133 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.133 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
134 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.134 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.34 KB
./usr/share/doc/python-scrapy-doc/html/topics/contracts.html
    
Offset 348, 15 lines modifiedOffset 348, 15 lines modified
348 ········<a·href="practices.html"·class="btn·btn-neutral·float-right"·title="Common·Practices"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>348 ········<a·href="practices.html"·class="btn·btn-neutral·float-right"·title="Common·Practices"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
349 ····</div>349 ····</div>
  
350 ··<hr/>350 ··<hr/>
  
351 ··<div·role="contentinfo">351 ··<div·role="contentinfo">
352 ····<p>&#169;·Copyright·Scrapy·developers.352 ····<p>&#169;·Copyright·Scrapy·developers.
353 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.353 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
354 ······</span></p>354 ······</span></p>
355 ··</div>355 ··</div>
  
356 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a356 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
357 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>357 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
358 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.358 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
359 ···359 ···
⊟
562 B
html2text {}
    
Offset 172, 9 lines modifiedOffset 172, 9 lines modified
172 ····name·=·"example"172 ····name·=·"example"
  
173 ····def·__init__(self):173 ····def·__init__(self):
174 ········if·os.environ.get("SCRAPY_CHECK"):174 ········if·os.environ.get("SCRAPY_CHECK"):
175 ············pass··#·Do·some·scraper·adjustments·when·a·check·is·running175 ············pass··#·Do·some·scraper·adjustments·when·a·check·is·running
176 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t176 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
177 ===============================================================================177 ===============================================================================
178 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.178 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
179 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.179 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.48 KB
./usr/share/doc/python-scrapy-doc/html/topics/coroutines.html
    
Offset 418, 15 lines modifiedOffset 418, 15 lines modified
418 ········<a·href="asyncio.html"·class="btn·btn-neutral·float-right"·title="asyncio"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>418 ········<a·href="asyncio.html"·class="btn·btn-neutral·float-right"·title="asyncio"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
419 ····</div>419 ····</div>
  
420 ··<hr/>420 ··<hr/>
  
421 ··<div·role="contentinfo">421 ··<div·role="contentinfo">
422 ····<p>&#169;·Copyright·Scrapy·developers.422 ····<p>&#169;·Copyright·Scrapy·developers.
423 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.423 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
424 ······</span></p>424 ······</span></p>
425 ··</div>425 ··</div>
  
426 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a426 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
427 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>427 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
428 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.428 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
429 ···429 ···
⊟
718 B
html2text {}
    
Offset 249, 9 lines modifiedOffset 249, 9 lines modified
249 and·works·in·earlier·Scrapy·versions·as·well.249 and·works·in·earlier·Scrapy·versions·as·well.
250 In·some·future·version·of·Scrapy,·however,·this·feature·will·be·deprecated·and,250 In·some·future·version·of·Scrapy,·however,·this·feature·will·be·deprecated·and,
251 eventually,·in·a·later·version·of·Scrapy,·this·feature·will·be·removed,·and·all251 eventually,·in·a·later·version·of·Scrapy,·this·feature·will·be·removed,·and·all
252 spider·middlewares·will·be·expected·to·define·their·process_spider_output252 spider·middlewares·will·be·expected·to·define·their·process_spider_output
253 method·as·an·asynchronous·generator.253 method·as·an·asynchronous·generator.
254 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t254 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
255 ===============================================================================255 ===============================================================================
256 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.256 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
257 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.257 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.29 KB
./usr/share/doc/python-scrapy-doc/html/topics/debug.html
    
Offset 331, 15 lines modifiedOffset 331, 15 lines modified
331 ········<a·href="contracts.html"·class="btn·btn-neutral·float-right"·title="Spiders·Contracts"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>331 ········<a·href="contracts.html"·class="btn·btn-neutral·float-right"·title="Spiders·Contracts"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
332 ····</div>332 ····</div>
  
333 ··<hr/>333 ··<hr/>
  
334 ··<div·role="contentinfo">334 ··<div·role="contentinfo">
335 ····<p>&#169;·Copyright·Scrapy·developers.335 ····<p>&#169;·Copyright·Scrapy·developers.
336 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.336 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
337 ······</span></p>337 ······</span></p>
338 ··</div>338 ··</div>
  
339 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a339 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
340 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>340 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
341 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.341 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
342 ···342 ···
⊟
517 B
html2text {}
    
Offset 195, 9 lines modifiedOffset 195, 9 lines modified
195 ········}195 ········}
196 ····]196 ····]
197 }197 }
198 Also,·make·sure·you·enable·“User·Uncaught·Exceptions”,·to·catch·exceptions·in198 Also,·make·sure·you·enable·“User·Uncaught·Exceptions”,·to·catch·exceptions·in
199 your·Scrapy·spider.199 your·Scrapy·spider.
200 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t200 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
201 ===============================================================================201 ===============================================================================
202 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.202 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
203 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.203 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.56 KB
./usr/share/doc/python-scrapy-doc/html/topics/deploy.html
    
Offset 196, 15 lines modifiedOffset 196, 15 lines modified
196 ········<a·href="autothrottle.html"·class="btn·btn-neutral·float-right"·title="AutoThrottle·extension"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>196 ········<a·href="autothrottle.html"·class="btn·btn-neutral·float-right"·title="AutoThrottle·extension"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
197 ····</div>197 ····</div>
  
198 ··<hr/>198 ··<hr/>
  
199 ··<div·role="contentinfo">199 ··<div·role="contentinfo">
200 ····<p>&#169;·Copyright·Scrapy·developers.200 ····<p>&#169;·Copyright·Scrapy·developers.
201 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.201 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
202 ······</span></p>202 ······</span></p>
203 ··</div>203 ··</div>
  
204 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a204 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
205 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>205 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
206 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.206 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
207 ···207 ···
⊟
789 B
html2text {}
    
Offset 85, 9 lines modifiedOffset 85, 9 lines modified
85 To·deploy·spiders·to·Zyte·Scrapy·Cloud·you·can·use·the·_\x8s_\x8h_\x8u_\x8b·command·line·tool.85 To·deploy·spiders·to·Zyte·Scrapy·Cloud·you·can·use·the·_\x8s_\x8h_\x8u_\x8b·command·line·tool.
86 Please·refer·to·the·_\x8Z_\x8y_\x8t_\x8e_\x8·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y_\x8·_\x8C_\x8l_\x8o_\x8u_\x8d_\x8·_\x8d_\x8o_\x8c_\x8u_\x8m_\x8e_\x8n_\x8t_\x8a_\x8t_\x8i_\x8o_\x8n·for·more·information.86 Please·refer·to·the·_\x8Z_\x8y_\x8t_\x8e_\x8·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y_\x8·_\x8C_\x8l_\x8o_\x8u_\x8d_\x8·_\x8d_\x8o_\x8c_\x8u_\x8m_\x8e_\x8n_\x8t_\x8a_\x8t_\x8i_\x8o_\x8n·for·more·information.
87 Zyte·Scrapy·Cloud·is·compatible·with·Scrapyd·and·one·can·switch·between·them·as87 Zyte·Scrapy·Cloud·is·compatible·with·Scrapyd·and·one·can·switch·between·them·as
88 needed·-·the·configuration·is·read·from·the·scrapy.cfg·file·just·like·scrapyd-88 needed·-·the·configuration·is·read·from·the·scrapy.cfg·file·just·like·scrapyd-
89 deploy.89 deploy.
90 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t90 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
91 ===============================================================================91 ===============================================================================
92 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.92 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
93 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.93 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.54 KB
./usr/share/doc/python-scrapy-doc/html/topics/developer-tools.html
    
Offset 422, 15 lines modifiedOffset 422, 15 lines modified
422 ········<a·href="dynamic-content.html"·class="btn·btn-neutral·float-right"·title="Selecting·dynamically-loaded·content"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>422 ········<a·href="dynamic-content.html"·class="btn·btn-neutral·float-right"·title="Selecting·dynamically-loaded·content"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
423 ····</div>423 ····</div>
  
424 ··<hr/>424 ··<hr/>
  
425 ··<div·role="contentinfo">425 ··<div·role="contentinfo">
426 ····<p>&#169;·Copyright·Scrapy·developers.426 ····<p>&#169;·Copyright·Scrapy·developers.
427 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.427 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
428 ······</span></p>428 ······</span></p>
429 ··</div>429 ··</div>
  
430 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a430 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
431 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>431 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
432 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.432 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
433 ···433 ···
⊟
730 B
html2text {}
    
Offset 276, 9 lines modifiedOffset 276, 9 lines modified
276 As·you·can·see,·with·a·few·inspections·in·theNetwork-tool·we·were·able·to276 As·you·can·see,·with·a·few·inspections·in·theNetwork-tool·we·were·able·to
277 easily·replicate·the·dynamic·requests·of·the·scrolling·functionality·of·the277 easily·replicate·the·dynamic·requests·of·the·scrolling·functionality·of·the
278 page.·Crawling·dynamic·pages·can·be·quite·daunting·and·pages·can·be·very278 page.·Crawling·dynamic·pages·can·be·quite·daunting·and·pages·can·be·very
279 complex,·but·it·(mostly)·boils·down·to·identifying·the·correct·request·and279 complex,·but·it·(mostly)·boils·down·to·identifying·the·correct·request·and
280 replicating·it·in·your·spider.280 replicating·it·in·your·spider.
281 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t281 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
282 ===============================================================================282 ===============================================================================
283 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.283 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
284 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.284 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.41 KB
./usr/share/doc/python-scrapy-doc/html/topics/djangoitem.html
    
Offset 159, 15 lines modifiedOffset 159, 15 lines modified
159 ··········</div>159 ··········</div>
160 ··········<footer>160 ··········<footer>
  
161 ··<hr/>161 ··<hr/>
  
162 ··<div·role="contentinfo">162 ··<div·role="contentinfo">
163 ····<p>&#169;·Copyright·Scrapy·developers.163 ····<p>&#169;·Copyright·Scrapy·developers.
164 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.164 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
165 ······</span></p>165 ······</span></p>
166 ··</div>166 ··</div>
  
167 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a167 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
168 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>168 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
169 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.169 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
170 ···170 ···
⊟
797 B
html2text {}
    
Offset 59, 9 lines modifiedOffset 59, 9 lines modified
59 ····*·_\x8V_\x8i_\x8e_\x8w_\x8·_\x8p_\x8a_\x8g_\x8e_\x8·_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e59 ····*·_\x8V_\x8i_\x8e_\x8w_\x8·_\x8p_\x8a_\x8g_\x8e_\x8·_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e
60 ===============================================================================60 ===============================================================================
61 *\x8**\x8**\x8**\x8**\x8**\x8*·D\x8Dj\x8ja\x8an\x8ng\x8go\x8oI\x8It\x8te\x8em\x8m_\x8?\x8·*\x8**\x8**\x8**\x8**\x8**\x8*61 *\x8**\x8**\x8**\x8**\x8**\x8*·D\x8Dj\x8ja\x8an\x8ng\x8go\x8oI\x8It\x8te\x8em\x8m_\x8?\x8·*\x8**\x8**\x8**\x8**\x8**\x8*
62 DjangoItem·has·been·moved·into·a·separate·project.62 DjangoItem·has·been·moved·into·a·separate·project.
63 It·is·hosted·at:63 It·is·hosted·at:
64 ·····_\x8h_\x8t_\x8t_\x8p_\x8s_\x8:_\x8/_\x8/_\x8g_\x8i_\x8t_\x8h_\x8u_\x8b_\x8._\x8c_\x8o_\x8m_\x8/_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8-_\x8p_\x8l_\x8u_\x8g_\x8i_\x8n_\x8s_\x8/_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8-_\x8d_\x8j_\x8a_\x8n_\x8g_\x8o_\x8i_\x8t_\x8e_\x8m64 ·····_\x8h_\x8t_\x8t_\x8p_\x8s_\x8:_\x8/_\x8/_\x8g_\x8i_\x8t_\x8h_\x8u_\x8b_\x8._\x8c_\x8o_\x8m_\x8/_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8-_\x8p_\x8l_\x8u_\x8g_\x8i_\x8n_\x8s_\x8/_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8-_\x8d_\x8j_\x8a_\x8n_\x8g_\x8o_\x8i_\x8t_\x8e_\x8m
65 ===============================================================================65 ===============================================================================
66 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.66 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
67 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.67 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.45 KB
./usr/share/doc/python-scrapy-doc/html/topics/downloader-middleware.html
    
Offset 1333, 15 lines modifiedOffset 1333, 15 lines modified
1333 ········<a·href="spider-middleware.html"·class="btn·btn-neutral·float-right"·title="Spider·Middleware"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>1333 ········<a·href="spider-middleware.html"·class="btn·btn-neutral·float-right"·title="Spider·Middleware"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
1334 ····</div>1334 ····</div>
  
1335 ··<hr/>1335 ··<hr/>
  
1336 ··<div·role="contentinfo">1336 ··<div·role="contentinfo">
1337 ····<p>&#169;·Copyright·Scrapy·developers.1337 ····<p>&#169;·Copyright·Scrapy·developers.
1338 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.1338 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
1339 ······</span></p>1339 ······</span></p>
1340 ··</div>1340 ··</div>
  
1341 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a1341 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
1342 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>1342 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
1343 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.1343 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
1344 ···1344 ···
⊟
643 B
html2text {}
    
Offset 831, 9 lines modifiedOffset 831, 9 lines modified
831 Default:·True831 Default:·True
832 Whether·or·not·to·enable·the·HttpProxyMiddleware.832 Whether·or·not·to·enable·the·HttpProxyMiddleware.
833 *\x8**\x8*·H\x8HT\x8TT\x8TP\x8PP\x8PR\x8RO\x8OX\x8XY\x8Y_\x8_A\x8AU\x8UT\x8TH\x8H_\x8_E\x8EN\x8NC\x8CO\x8OD\x8DI\x8IN\x8NG\x8G_\x8?\x8·*\x8**\x8*833 *\x8**\x8*·H\x8HT\x8TT\x8TP\x8PP\x8PR\x8RO\x8OX\x8XY\x8Y_\x8_A\x8AU\x8UT\x8TH\x8H_\x8_E\x8EN\x8NC\x8CO\x8OD\x8DI\x8IN\x8NG\x8G_\x8?\x8·*\x8**\x8*
834 Default:·"latin-1"834 Default:·"latin-1"
835 The·default·encoding·for·proxy·authentication·on·HttpProxyMiddleware.835 The·default·encoding·for·proxy·authentication·on·HttpProxyMiddleware.
836 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t836 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
837 ===============================================================================837 ===============================================================================
838 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.838 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
839 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.839 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.53 KB
./usr/share/doc/python-scrapy-doc/html/topics/dynamic-content.html
    
Offset 383, 15 lines modifiedOffset 383, 15 lines modified
383 ········<a·href="leaks.html"·class="btn·btn-neutral·float-right"·title="Debugging·memory·leaks"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>383 ········<a·href="leaks.html"·class="btn·btn-neutral·float-right"·title="Debugging·memory·leaks"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
384 ····</div>384 ····</div>
  
385 ··<hr/>385 ··<hr/>
  
386 ··<div·role="contentinfo">386 ··<div·role="contentinfo">
387 ····<p>&#169;·Copyright·Scrapy·developers.387 ····<p>&#169;·Copyright·Scrapy·developers.
388 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.388 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
389 ······</span></p>389 ······</span></p>
390 ··</div>390 ··</div>
  
391 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a391 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
392 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>392 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
393 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.393 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
394 ···394 ···
⊟
747 B
html2text {}
    
Offset 225, 9 lines modifiedOffset 225, 9 lines modified
225 ············title·=·await·page.title()225 ············title·=·await·page.title()
226 ············return·{"title":·title}226 ············return·{"title":·title}
227 However,·using·_\x8p_\x8l_\x8a_\x8y_\x8w_\x8r_\x8i_\x8g_\x8h_\x8t_\x8-_\x8p_\x8y_\x8t_\x8h_\x8o_\x8n·directly·as·in·the·above·example·circumvents227 However,·using·_\x8p_\x8l_\x8a_\x8y_\x8w_\x8r_\x8i_\x8g_\x8h_\x8t_\x8-_\x8p_\x8y_\x8t_\x8h_\x8o_\x8n·directly·as·in·the·above·example·circumvents
228 most·of·the·Scrapy·components·(middlewares,·dupefilter,·etc).·We·recommend228 most·of·the·Scrapy·components·(middlewares,·dupefilter,·etc).·We·recommend
229 using·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8-_\x8p_\x8l_\x8a_\x8y_\x8w_\x8r_\x8i_\x8g_\x8h_\x8t·for·a·better·integration.229 using·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8-_\x8p_\x8l_\x8a_\x8y_\x8w_\x8r_\x8i_\x8g_\x8h_\x8t·for·a·better·integration.
230 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t230 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
231 ===============================================================================231 ===============================================================================
232 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.232 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
233 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.233 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.43 KB
./usr/share/doc/python-scrapy-doc/html/topics/email.html
    
Offset 314, 15 lines modifiedOffset 314, 15 lines modified
314 ········<a·href="telnetconsole.html"·class="btn·btn-neutral·float-right"·title="Telnet·Console"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>314 ········<a·href="telnetconsole.html"·class="btn·btn-neutral·float-right"·title="Telnet·Console"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
315 ····</div>315 ····</div>
  
316 ··<hr/>316 ··<hr/>
  
317 ··<div·role="contentinfo">317 ··<div·role="contentinfo">
318 ····<p>&#169;·Copyright·Scrapy·developers.318 ····<p>&#169;·Copyright·Scrapy·developers.
319 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.319 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
320 ······</span></p>320 ······</span></p>
321 ··</div>321 ··</div>
  
322 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a322 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
323 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>323 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
324 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.324 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
325 ···325 ···
⊟
661 B
html2text {}
    
Offset 160, 9 lines modifiedOffset 160, 9 lines modified
160 Enforce·using·STARTTLS.·STARTTLS·is·a·way·to·take·an·existing·insecure160 Enforce·using·STARTTLS.·STARTTLS·is·a·way·to·take·an·existing·insecure
161 connection,·and·upgrade·it·to·a·secure·connection·using·SSL/TLS.161 connection,·and·upgrade·it·to·a·secure·connection·using·SSL/TLS.
162 *\x8**\x8**\x8**\x8*·M\x8MA\x8AI\x8IL\x8L_\x8_S\x8SS\x8SL\x8L_\x8?\x8·*\x8**\x8**\x8**\x8*162 *\x8**\x8**\x8**\x8*·M\x8MA\x8AI\x8IL\x8L_\x8_S\x8SS\x8SL\x8L_\x8?\x8·*\x8**\x8**\x8**\x8*
163 Default:·False163 Default:·False
164 Enforce·connecting·using·an·SSL·encrypted·connection164 Enforce·connecting·using·an·SSL·encrypted·connection
165 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t165 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
166 ===============================================================================166 ===============================================================================
167 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.167 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
168 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.168 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.59 KB
./usr/share/doc/python-scrapy-doc/html/topics/exceptions.html
    
Offset 311, 15 lines modifiedOffset 311, 15 lines modified
311 ········<a·href="logging.html"·class="btn·btn-neutral·float-right"·title="Logging"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>311 ········<a·href="logging.html"·class="btn·btn-neutral·float-right"·title="Logging"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
312 ····</div>312 ····</div>
  
313 ··<hr/>313 ··<hr/>
  
314 ··<div·role="contentinfo">314 ··<div·role="contentinfo">
315 ····<p>&#169;·Copyright·Scrapy·developers.315 ····<p>&#169;·Copyright·Scrapy·developers.
316 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.316 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
317 ······</span></p>317 ······</span></p>
318 ··</div>318 ··</div>
  
319 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a319 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
320 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>320 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
321 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.321 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
322 ···322 ···
⊟
827 B
html2text {}
    
Offset 132, 9 lines modifiedOffset 132, 9 lines modified
132 fail·is·a·keyword-only·parameter,·i.e.·raising·StopDownload(False)·or132 fail·is·a·keyword-only·parameter,·i.e.·raising·StopDownload(False)·or
133 StopDownload(True)·will·raise·a·_\x8T_\x8y_\x8p_\x8e_\x8E_\x8r_\x8r_\x8o_\x8r.133 StopDownload(True)·will·raise·a·_\x8T_\x8y_\x8p_\x8e_\x8E_\x8r_\x8r_\x8o_\x8r.
134 See·the·documentation·for·the·_\x8b_\x8y_\x8t_\x8e_\x8s_\x8__\x8r_\x8e_\x8c_\x8e_\x8i_\x8v_\x8e_\x8d·and·_\x8h_\x8e_\x8a_\x8d_\x8e_\x8r_\x8s_\x8__\x8r_\x8e_\x8c_\x8e_\x8i_\x8v_\x8e_\x8d·signals·and134 See·the·documentation·for·the·_\x8b_\x8y_\x8t_\x8e_\x8s_\x8__\x8r_\x8e_\x8c_\x8e_\x8i_\x8v_\x8e_\x8d·and·_\x8h_\x8e_\x8a_\x8d_\x8e_\x8r_\x8s_\x8__\x8r_\x8e_\x8c_\x8e_\x8i_\x8v_\x8e_\x8d·signals·and
135 the·_\x8S_\x8t_\x8o_\x8p_\x8p_\x8i_\x8n_\x8g_\x8·_\x8t_\x8h_\x8e_\x8·_\x8d_\x8o_\x8w_\x8n_\x8l_\x8o_\x8a_\x8d_\x8·_\x8o_\x8f_\x8·_\x8a_\x8·_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e·topic·for·additional·information·and135 the·_\x8S_\x8t_\x8o_\x8p_\x8p_\x8i_\x8n_\x8g_\x8·_\x8t_\x8h_\x8e_\x8·_\x8d_\x8o_\x8w_\x8n_\x8l_\x8o_\x8a_\x8d_\x8·_\x8o_\x8f_\x8·_\x8a_\x8·_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e·topic·for·additional·information·and
136 examples.136 examples.
137 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t137 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
138 ===============================================================================138 ===============================================================================
139 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.139 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
140 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.140 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.5 KB
./usr/share/doc/python-scrapy-doc/html/topics/exporters.html
    
Offset 669, 15 lines modifiedOffset 669, 15 lines modified
669 ········<a·href="components.html"·class="btn·btn-neutral·float-right"·title="Components"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>669 ········<a·href="components.html"·class="btn·btn-neutral·float-right"·title="Components"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
670 ····</div>670 ····</div>
  
671 ··<hr/>671 ··<hr/>
  
672 ··<div·role="contentinfo">672 ··<div·role="contentinfo">
673 ····<p>&#169;·Copyright·Scrapy·developers.673 ····<p>&#169;·Copyright·Scrapy·developers.
674 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.674 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
675 ······</span></p>675 ······</span></p>
676 ··</div>676 ··</div>
  
677 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a677 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
678 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>678 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
679 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.679 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
680 ···680 ···
⊟
728 B
html2text {}
    
Offset 390, 9 lines modifiedOffset 390, 9 lines modified
390 ······Exports·items·in·a·Python-specific·binary·format·(see·_\x8m_\x8a_\x8r_\x8s_\x8h_\x8a_\x8l).390 ······Exports·items·in·a·Python-specific·binary·format·(see·_\x8m_\x8a_\x8r_\x8s_\x8h_\x8a_\x8l).
391 ········Parameters:391 ········Parameters:
392 ············f\x8fi\x8il\x8le\x8e·–·The·file-like·object·to·use·for·exporting·the·data.·Its392 ············f\x8fi\x8il\x8le\x8e·–·The·file-like·object·to·use·for·exporting·the·data.·Its
393 ············write·method·should·accept·_\x8b_\x8y_\x8t_\x8e_\x8s·(a·disk·file·opened·in·binary393 ············write·method·should·accept·_\x8b_\x8y_\x8t_\x8e_\x8s·(a·disk·file·opened·in·binary
394 ············mode,·a·_\x8B_\x8y_\x8t_\x8e_\x8s_\x8I_\x8O·object,·etc)394 ············mode,·a·_\x8B_\x8y_\x8t_\x8e_\x8s_\x8I_\x8O·object,·etc)
395 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t395 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
396 ===============================================================================396 ===============================================================================
397 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.397 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
398 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.398 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.52 KB
./usr/share/doc/python-scrapy-doc/html/topics/extensions.html
    
Offset 651, 15 lines modifiedOffset 651, 15 lines modified
651 ········<a·href="signals.html"·class="btn·btn-neutral·float-right"·title="Signals"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>651 ········<a·href="signals.html"·class="btn·btn-neutral·float-right"·title="Signals"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
652 ····</div>652 ····</div>
  
653 ··<hr/>653 ··<hr/>
  
654 ··<div·role="contentinfo">654 ··<div·role="contentinfo">
655 ····<p>&#169;·Copyright·Scrapy·developers.655 ····<p>&#169;·Copyright·Scrapy·developers.
656 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.656 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
657 ······</span></p>657 ······</span></p>
658 ··</div>658 ··</div>
  
659 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a659 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
660 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>660 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
661 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.661 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
662 ···662 ···
⊟
751 B
html2text {}
    
Offset 396, 9 lines modifiedOffset 396, 9 lines modified
396 ··c\x8cl\x8la\x8as\x8ss\x8s·scrapy.extensions.periodic_log.Debugger_\x8396 ··c\x8cl\x8la\x8as\x8ss\x8s·scrapy.extensions.periodic_log.Debugger_\x8
397 Invokes·a·_\x8P_\x8y_\x8t_\x8h_\x8o_\x8n_\x8·_\x8d_\x8e_\x8b_\x8u_\x8g_\x8g_\x8e_\x8r·inside·a·running·Scrapy·process·when·a·_\x8S_\x8I_\x8G_\x8U_\x8S_\x8R_\x82·signal397 Invokes·a·_\x8P_\x8y_\x8t_\x8h_\x8o_\x8n_\x8·_\x8d_\x8e_\x8b_\x8u_\x8g_\x8g_\x8e_\x8r·inside·a·running·Scrapy·process·when·a·_\x8S_\x8I_\x8G_\x8U_\x8S_\x8R_\x82·signal
398 is·received.·After·the·debugger·is·exited,·the·Scrapy·process·continues·running398 is·received.·After·the·debugger·is·exited,·the·Scrapy·process·continues·running
399 normally.399 normally.
400 This·extension·only·works·on·POSIX-compliant·platforms·(i.e.·not·Windows).400 This·extension·only·works·on·POSIX-compliant·platforms·(i.e.·not·Windows).
401 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t401 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
402 ===============================================================================402 ===============================================================================
403 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.403 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
404 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.404 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.47 KB
./usr/share/doc/python-scrapy-doc/html/topics/feed-exports.html
    
Offset 957, 15 lines modifiedOffset 957, 15 lines modified
957 ········<a·href="request-response.html"·class="btn·btn-neutral·float-right"·title="Requests·and·Responses"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>957 ········<a·href="request-response.html"·class="btn·btn-neutral·float-right"·title="Requests·and·Responses"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
958 ····</div>958 ····</div>
  
959 ··<hr/>959 ··<hr/>
  
960 ··<div·role="contentinfo">960 ··<div·role="contentinfo">
961 ····<p>&#169;·Copyright·Scrapy·developers.961 ····<p>&#169;·Copyright·Scrapy·developers.
962 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.962 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
963 ······</span></p>963 ······</span></p>
964 ··</div>964 ··</div>
  
965 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a965 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
966 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>966 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
967 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.967 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
968 ···968 ···
⊟
681 B
html2text {}
    
Offset 561, 9 lines modifiedOffset 561, 9 lines modified
561 ···2.·Point·_\x8F_\x8E_\x8E_\x8D_\x8__\x8U_\x8R_\x8I_\x8__\x8P_\x8A_\x8R_\x8A_\x8M_\x8S·to·that·function·in·your·settings:561 ···2.·Point·_\x8F_\x8E_\x8E_\x8D_\x8__\x8U_\x8R_\x8I_\x8__\x8P_\x8A_\x8R_\x8A_\x8M_\x8S·to·that·function·in·your·settings:
562 ······#·myproject/settings.py562 ······#·myproject/settings.py
563 ······FEED_URI_PARAMS·=·"myproject.utils.uri_params"563 ······FEED_URI_PARAMS·=·"myproject.utils.uri_params"
564 ···3.·Use·%(spider_name)s·in·your·feed·URI:564 ···3.·Use·%(spider_name)s·in·your·feed·URI:
565 ······scrapy·crawl·<spider_name>·-o·"%(spider_name)s.jsonl"565 ······scrapy·crawl·<spider_name>·-o·"%(spider_name)s.jsonl"
566 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t566 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
567 ===============================================================================567 ===============================================================================
568 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.568 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
569 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.569 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.45 KB
./usr/share/doc/python-scrapy-doc/html/topics/item-pipeline.html
    
Offset 433, 15 lines modifiedOffset 433, 15 lines modified
433 ········<a·href="feed-exports.html"·class="btn·btn-neutral·float-right"·title="Feed·exports"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>433 ········<a·href="feed-exports.html"·class="btn·btn-neutral·float-right"·title="Feed·exports"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
434 ····</div>434 ····</div>
  
435 ··<hr/>435 ··<hr/>
  
436 ··<div·role="contentinfo">436 ··<div·role="contentinfo">
437 ····<p>&#169;·Copyright·Scrapy·developers.437 ····<p>&#169;·Copyright·Scrapy·developers.
438 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.438 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
439 ······</span></p>439 ······</span></p>
440 ··</div>440 ··</div>
  
441 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a441 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
442 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>442 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
443 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.443 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
444 ···444 ···
⊟
671 B
html2text {}
    
Offset 261, 9 lines modifiedOffset 261, 9 lines modified
261 ····"myproject.pipelines.JsonWriterPipeline":·800,261 ····"myproject.pipelines.JsonWriterPipeline":·800,
262 }262 }
263 The·integer·values·you·assign·to·classes·in·this·setting·determine·the·order·in263 The·integer·values·you·assign·to·classes·in·this·setting·determine·the·order·in
264 which·they·run:·items·go·through·from·lower·valued·to·higher·valued·classes.264 which·they·run:·items·go·through·from·lower·valued·to·higher·valued·classes.
265 It’s·customary·to·define·these·numbers·in·the·0-1000·range.265 It’s·customary·to·define·these·numbers·in·the·0-1000·range.
266 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t266 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
267 ===============================================================================267 ===============================================================================
268 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.268 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
269 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.269 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.71 KB
./usr/share/doc/python-scrapy-doc/html/topics/items.html
    
Offset 542, 15 lines modifiedOffset 542, 15 lines modified
542 ········<a·href="loaders.html"·class="btn·btn-neutral·float-right"·title="Item·Loaders"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>542 ········<a·href="loaders.html"·class="btn·btn-neutral·float-right"·title="Item·Loaders"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
543 ····</div>543 ····</div>
  
544 ··<hr/>544 ··<hr/>
  
545 ··<div·role="contentinfo">545 ··<div·role="contentinfo">
546 ····<p>&#169;·Copyright·Scrapy·developers.546 ····<p>&#169;·Copyright·Scrapy·developers.
547 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.547 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
548 ······</span></p>548 ······</span></p>
549 ··</div>549 ··</div>
  
550 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a550 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
551 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>551 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
552 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.552 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
553 ···553 ···
⊟
954 B
html2text {}
    
Offset 321, 9 lines modifiedOffset 321, 9 lines modified
321 ()·function·to·write·code·that·works·for·any·supported·item·type.321 ()·function·to·write·code·that·works·for·any·supported·item·type.
322 *\x8**\x8**\x8**\x8**\x8*·O\x8Ot\x8th\x8he\x8er\x8r·c\x8cl\x8la\x8as\x8ss\x8se\x8es\x8s·r\x8re\x8el\x8la\x8at\x8te\x8ed\x8d·t\x8to\x8o·i\x8it\x8te\x8em\x8ms\x8s_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*322 *\x8**\x8**\x8**\x8**\x8*·O\x8Ot\x8th\x8he\x8er\x8r·c\x8cl\x8la\x8as\x8ss\x8se\x8es\x8s·r\x8re\x8el\x8la\x8at\x8te\x8ed\x8d·t\x8to\x8o·i\x8it\x8te\x8em\x8ms\x8s_\x8?\x8·*\x8**\x8**\x8**\x8**\x8*
323 ··c\x8cl\x8la\x8as\x8ss\x8s·scrapy.item.ItemMeta(c\x8cl\x8la\x8as\x8ss\x8s_\x8_n\x8na\x8am\x8me\x8e:\x8:·_\x8s\x8s_\x8t\x8t_\x8r\x8r,·b\x8ba\x8as\x8se\x8es\x8s:\x8:·_\x8t\x8t_\x8u\x8u_\x8p\x8p_\x8l\x8l_\x8e\x8e[\x8[_\x8t\x8t_\x8y\x8y_\x8p\x8p_\x8e\x8e,\x8,·.\x8..\x8..\x8.]\x8],·a\x8at\x8tt\x8tr\x8rs\x8s:\x8:323 ··c\x8cl\x8la\x8as\x8ss\x8s·scrapy.item.ItemMeta(c\x8cl\x8la\x8as\x8ss\x8s_\x8_n\x8na\x8am\x8me\x8e:\x8:·_\x8s\x8s_\x8t\x8t_\x8r\x8r,·b\x8ba\x8as\x8se\x8es\x8s:\x8:·_\x8t\x8t_\x8u\x8u_\x8p\x8p_\x8l\x8l_\x8e\x8e[\x8[_\x8t\x8t_\x8y\x8y_\x8p\x8p_\x8e\x8e,\x8,·.\x8..\x8..\x8.]\x8],·a\x8at\x8tt\x8tr\x8rs\x8s:\x8:
324 ··_\x8d\x8d_\x8i\x8i_\x8c\x8c_\x8t\x8t[\x8[_\x8s\x8s_\x8t\x8t_\x8r\x8r,\x8,·_\x8A\x8A_\x8n\x8n_\x8y\x8y]\x8])_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x8324 ··_\x8d\x8d_\x8i\x8i_\x8c\x8c_\x8t\x8t[\x8[_\x8s\x8s_\x8t\x8t_\x8r\x8r,\x8,·_\x8A\x8A_\x8n\x8n_\x8y\x8y]\x8])_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x8
325 ······_\x8M_\x8e_\x8t_\x8a_\x8c_\x8l_\x8a_\x8s_\x8s·of·_\x8I_\x8t_\x8e_\x8m·that·handles·field·definitions.325 ······_\x8M_\x8e_\x8t_\x8a_\x8c_\x8l_\x8a_\x8s_\x8s·of·_\x8I_\x8t_\x8e_\x8m·that·handles·field·definitions.
326 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t326 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
327 ===============================================================================327 ===============================================================================
328 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.328 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
329 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.329 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.49 KB
./usr/share/doc/python-scrapy-doc/html/topics/jobs.html
    
Offset 236, 15 lines modifiedOffset 236, 15 lines modified
236 ········<a·href="coroutines.html"·class="btn·btn-neutral·float-right"·title="Coroutines"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>236 ········<a·href="coroutines.html"·class="btn·btn-neutral·float-right"·title="Coroutines"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
237 ····</div>237 ····</div>
  
238 ··<hr/>238 ··<hr/>
  
239 ··<div·role="contentinfo">239 ··<div·role="contentinfo">
240 ····<p>&#169;·Copyright·Scrapy·developers.240 ····<p>&#169;·Copyright·Scrapy·developers.
241 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.241 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
242 ······</span></p>242 ······</span></p>
243 ··</div>243 ··</div>
  
244 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a244 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
245 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>245 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
246 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.246 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
247 ···247 ···
⊟
735 B
html2text {}
    
Offset 109, 9 lines modifiedOffset 109, 9 lines modified
109 except·for·the·callback·and·errback·values·passed·to·their·__init__·method,109 except·for·the·callback·and·errback·values·passed·to·their·__init__·method,
110 which·must·be·methods·of·the·running·_\x8S_\x8p_\x8i_\x8d_\x8e_\x8r·class.110 which·must·be·methods·of·the·running·_\x8S_\x8p_\x8i_\x8d_\x8e_\x8r·class.
111 If·you·wish·to·log·the·requests·that·couldn’t·be·serialized,·you·can·set·the111 If·you·wish·to·log·the·requests·that·couldn’t·be·serialized,·you·can·set·the
112 _\x8S_\x8C_\x8H_\x8E_\x8D_\x8U_\x8L_\x8E_\x8R_\x8__\x8D_\x8E_\x8B_\x8U_\x8G·setting·to·True·in·the·project’s·settings·page.·It·is·False·by112 _\x8S_\x8C_\x8H_\x8E_\x8D_\x8U_\x8L_\x8E_\x8R_\x8__\x8D_\x8E_\x8B_\x8U_\x8G·setting·to·True·in·the·project’s·settings·page.·It·is·False·by
113 default.113 default.
114 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t114 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
115 ===============================================================================115 ===============================================================================
116 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.116 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
117 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.117 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.72 KB
./usr/share/doc/python-scrapy-doc/html/topics/leaks.html
    
Offset 431, 15 lines modifiedOffset 431, 15 lines modified
431 ········<a·href="media-pipeline.html"·class="btn·btn-neutral·float-right"·title="Downloading·and·processing·files·and·images"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>431 ········<a·href="media-pipeline.html"·class="btn·btn-neutral·float-right"·title="Downloading·and·processing·files·and·images"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
432 ····</div>432 ····</div>
  
433 ··<hr/>433 ··<hr/>
  
434 ··<div·role="contentinfo">434 ··<div·role="contentinfo">
435 ····<p>&#169;·Copyright·Scrapy·developers.435 ····<p>&#169;·Copyright·Scrapy·developers.
436 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.436 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
437 ······</span></p>437 ······</span></p>
438 ··</div>438 ··</div>
  
439 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a439 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
440 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>440 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
441 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.441 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
442 ···442 ···
⊟
927 B
html2text {}
    
Offset 255, 9 lines modifiedOffset 255, 9 lines modified
255 ·····c\x8co\x8ol\x8ll\x8le\x8ec\x8ct\x8to\x8or\x8r,\x8,·w\x8wh\x8hi\x8ic\x8ch\x8h·i\x8is\x8s·a\x8ab\x8bl\x8le\x8e·t\x8to\x8o·m\x8mo\x8ov\x8ve\x8e·o\x8ob\x8bj\x8je\x8ec\x8ct\x8ts\x8s·i\x8in\x8n·m\x8me\x8em\x8mo\x8or\x8ry\x8y.\x8.·T\x8Th\x8hi\x8is\x8s·w\x8wo\x8ou\x8ul\x8ld\x8d255 ·····c\x8co\x8ol\x8ll\x8le\x8ec\x8ct\x8to\x8or\x8r,\x8,·w\x8wh\x8hi\x8ic\x8ch\x8h·i\x8is\x8s·a\x8ab\x8bl\x8le\x8e·t\x8to\x8o·m\x8mo\x8ov\x8ve\x8e·o\x8ob\x8bj\x8je\x8ec\x8ct\x8ts\x8s·i\x8in\x8n·m\x8me\x8em\x8mo\x8or\x8ry\x8y.\x8.·T\x8Th\x8hi\x8is\x8s·w\x8wo\x8ou\x8ul\x8ld\x8d
256 ·····r\x8re\x8eq\x8qu\x8ui\x8ir\x8re\x8e·s\x8si\x8ig\x8gn\x8ni\x8if\x8fi\x8ic\x8ca\x8an\x8nt\x8t·c\x8ch\x8ha\x8an\x8ng\x8ge\x8es\x8s·t\x8to\x8o·t\x8th\x8he\x8e·P\x8Py\x8yt\x8th\x8ho\x8on\x8n·i\x8in\x8nt\x8te\x8er\x8rp\x8pr\x8re\x8et\x8te\x8er\x8r.\x8.256 ·····r\x8re\x8eq\x8qu\x8ui\x8ir\x8re\x8e·s\x8si\x8ig\x8gn\x8ni\x8if\x8fi\x8ic\x8ca\x8an\x8nt\x8t·c\x8ch\x8ha\x8an\x8ng\x8ge\x8es\x8s·t\x8to\x8o·t\x8th\x8he\x8e·P\x8Py\x8yt\x8th\x8ho\x8on\x8n·i\x8in\x8nt\x8te\x8er\x8rp\x8pr\x8re\x8et\x8te\x8er\x8r.\x8.
257 To·keep·memory·consumption·reasonable·you·can·split·the·job·into·several257 To·keep·memory·consumption·reasonable·you·can·split·the·job·into·several
258 smaller·jobs·or·enable·_\x8p_\x8e_\x8r_\x8s_\x8i_\x8s_\x8t_\x8e_\x8n_\x8t_\x8·_\x8j_\x8o_\x8b_\x8·_\x8q_\x8u_\x8e_\x8u_\x8e·and·stop/start·spider·from·time·to258 smaller·jobs·or·enable·_\x8p_\x8e_\x8r_\x8s_\x8i_\x8s_\x8t_\x8e_\x8n_\x8t_\x8·_\x8j_\x8o_\x8b_\x8·_\x8q_\x8u_\x8e_\x8u_\x8e·and·stop/start·spider·from·time·to
259 time.259 time.
260 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t260 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
261 ===============================================================================261 ===============================================================================
262 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.262 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
263 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.263 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.52 KB
./usr/share/doc/python-scrapy-doc/html/topics/link-extractors.html
    
Offset 318, 15 lines modifiedOffset 318, 15 lines modified
318 ········<a·href="settings.html"·class="btn·btn-neutral·float-right"·title="Settings"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>318 ········<a·href="settings.html"·class="btn·btn-neutral·float-right"·title="Settings"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
319 ····</div>319 ····</div>
  
320 ··<hr/>320 ··<hr/>
  
321 ··<div·role="contentinfo">321 ··<div·role="contentinfo">
322 ····<p>&#169;·Copyright·Scrapy·developers.322 ····<p>&#169;·Copyright·Scrapy·developers.
323 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.323 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
324 ······</span></p>324 ······</span></p>
325 ··</div>325 ··</div>
  
326 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a326 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
327 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>327 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
328 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.328 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
329 ···329 ···
⊟
741 B
html2text {}
    
Offset 106, 9 lines modifiedOffset 106, 9 lines modified
106 ··················Dont·follow·this·one.106 ··················Dont·follow·this·one.
107 ················*·f\x8fr\x8ra\x8ag\x8gm\x8me\x8en\x8nt\x8t·–·the·part·of·the·url·after·the·hash·symbol.·From107 ················*·f\x8fr\x8ra\x8ag\x8gm\x8me\x8en\x8nt\x8t·–·the·part·of·the·url·after·the·hash·symbol.·From
108 ··················the·sample,·this·is·foo.108 ··················the·sample,·this·is·foo.
109 ················*·n\x8no\x8of\x8fo\x8ol\x8ll\x8lo\x8ow\x8w·–·an·indication·of·the·presence·or·absence·of·a109 ················*·n\x8no\x8of\x8fo\x8ol\x8ll\x8lo\x8ow\x8w·–·an·indication·of·the·presence·or·absence·of·a
110 ··················nofollow·value·in·the·rel·attribute·of·the·anchor·tag.110 ··················nofollow·value·in·the·rel·attribute·of·the·anchor·tag.
111 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t111 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
112 ===============================================================================112 ===============================================================================
113 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.113 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
114 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.114 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.48 KB
./usr/share/doc/python-scrapy-doc/html/topics/loaders.html
    
Offset 948, 15 lines modifiedOffset 948, 15 lines modified
948 ········<a·href="shell.html"·class="btn·btn-neutral·float-right"·title="Scrapy·shell"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>948 ········<a·href="shell.html"·class="btn·btn-neutral·float-right"·title="Scrapy·shell"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
949 ····</div>949 ····</div>
  
950 ··<hr/>950 ··<hr/>
  
951 ··<div·role="contentinfo">951 ··<div·role="contentinfo">
952 ····<p>&#169;·Copyright·Scrapy·developers.952 ····<p>&#169;·Copyright·Scrapy·developers.
953 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.953 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
954 ······</span></p>954 ······</span></p>
955 ··</div>955 ··</div>
  
956 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a956 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
957 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>957 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
958 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.958 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
959 ···959 ···
⊟
717 B
html2text {}
    
Offset 617, 9 lines modifiedOffset 617, 9 lines modified
617 There·are·many·other·possible·ways·to·extend,·inherit·and·override·your·Item617 There·are·many·other·possible·ways·to·extend,·inherit·and·override·your·Item
618 Loaders,·and·different·Item·Loaders·hierarchies·may·fit·better·for·different618 Loaders,·and·different·Item·Loaders·hierarchies·may·fit·better·for·different
619 projects.·Scrapy·only·provides·the·mechanism;·it·doesn’t·impose·any·specific619 projects.·Scrapy·only·provides·the·mechanism;·it·doesn’t·impose·any·specific
620 organization·of·your·Loaders·collection·-·that’s·up·to·you·and·your·project’s620 organization·of·your·Loaders·collection·-·that’s·up·to·you·and·your·project’s
621 needs.621 needs.
622 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t622 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
623 ===============================================================================623 ===============================================================================
624 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.624 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
625 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.625 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.41 KB
./usr/share/doc/python-scrapy-doc/html/topics/logging.html
    
Offset 585, 15 lines modifiedOffset 585, 15 lines modified
585 ········<a·href="stats.html"·class="btn·btn-neutral·float-right"·title="Stats·Collection"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>585 ········<a·href="stats.html"·class="btn·btn-neutral·float-right"·title="Stats·Collection"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
586 ····</div>586 ····</div>
  
587 ··<hr/>587 ··<hr/>
  
588 ··<div·role="contentinfo">588 ··<div·role="contentinfo">
589 ····<p>&#169;·Copyright·Scrapy·developers.589 ····<p>&#169;·Copyright·Scrapy·developers.
590 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.590 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
591 ······</span></p>591 ······</span></p>
592 ··</div>592 ··</div>
  
593 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a593 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
594 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>594 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
595 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.595 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
596 ···596 ···
⊟
641 B
html2text {}
    
Offset 362, 9 lines modifiedOffset 362, 9 lines modified
362 ··········filename="log.txt",·format="%(levelname)s:·%(message)s",362 ··········filename="log.txt",·format="%(levelname)s:·%(message)s",
363 ······level=logging.INFO363 ······level=logging.INFO
364 ······)364 ······)
365 ······Refer·to·_\x8R_\x8u_\x8n_\x8·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y_\x8·_\x8f_\x8r_\x8o_\x8m_\x8·_\x8a_\x8·_\x8s_\x8c_\x8r_\x8i_\x8p_\x8t·for·more·details·about·using·Scrapy365 ······Refer·to·_\x8R_\x8u_\x8n_\x8·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y_\x8·_\x8f_\x8r_\x8o_\x8m_\x8·_\x8a_\x8·_\x8s_\x8c_\x8r_\x8i_\x8p_\x8t·for·more·details·about·using·Scrapy
366 ······this·way.366 ······this·way.
367 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t367 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
368 ===============================================================================368 ===============================================================================
369 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.369 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
370 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.370 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.48 KB
./usr/share/doc/python-scrapy-doc/html/topics/media-pipeline.html
    
Offset 815, 15 lines modifiedOffset 815, 15 lines modified
815 ········<a·href="deploy.html"·class="btn·btn-neutral·float-right"·title="Deploying·Spiders"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>815 ········<a·href="deploy.html"·class="btn·btn-neutral·float-right"·title="Deploying·Spiders"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
816 ····</div>816 ····</div>
  
817 ··<hr/>817 ··<hr/>
  
818 ··<div·role="contentinfo">818 ··<div·role="contentinfo">
819 ····<p>&#169;·Copyright·Scrapy·developers.819 ····<p>&#169;·Copyright·Scrapy·developers.
820 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.820 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
821 ······</span></p>821 ······</span></p>
822 ··</div>822 ··</div>
  
823 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a823 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
824 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>824 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
825 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.825 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
826 ···826 ···
⊟
701 B
html2text {}
    
Offset 525, 9 lines modifiedOffset 525, 9 lines modified
525 ········adapter["image_paths"]·=·image_paths525 ········adapter["image_paths"]·=·image_paths
526 ········return·item526 ········return·item
527 To·enable·your·custom·media·pipeline·component·you·must·add·its·class·import527 To·enable·your·custom·media·pipeline·component·you·must·add·its·class·import
528 path·to·the·_\x8I_\x8T_\x8E_\x8M_\x8__\x8P_\x8I_\x8P_\x8E_\x8L_\x8I_\x8N_\x8E_\x8S·setting,·like·in·the·following·example:528 path·to·the·_\x8I_\x8T_\x8E_\x8M_\x8__\x8P_\x8I_\x8P_\x8E_\x8L_\x8I_\x8N_\x8E_\x8S·setting,·like·in·the·following·example:
529 ITEM_PIPELINES·=·{"myproject.pipelines.MyImagesPipeline":·300}529 ITEM_PIPELINES·=·{"myproject.pipelines.MyImagesPipeline":·300}
530 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t530 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
531 ===============================================================================531 ===============================================================================
532 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.532 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
533 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.533 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.57 KB
./usr/share/doc/python-scrapy-doc/html/topics/practices.html
    
Offset 452, 15 lines modifiedOffset 452, 15 lines modified
452 ········<a·href="broad-crawls.html"·class="btn·btn-neutral·float-right"·title="Broad·Crawls"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>452 ········<a·href="broad-crawls.html"·class="btn·btn-neutral·float-right"·title="Broad·Crawls"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
453 ····</div>453 ····</div>
  
454 ··<hr/>454 ··<hr/>
  
455 ··<div·role="contentinfo">455 ··<div·role="contentinfo">
456 ····<p>&#169;·Copyright·Scrapy·developers.456 ····<p>&#169;·Copyright·Scrapy·developers.
457 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.457 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
458 ······</span></p>458 ······</span></p>
459 ··</div>459 ··</div>
  
460 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a460 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
461 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>461 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
462 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.462 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
463 ···463 ···
⊟
796 B
html2text {}
    
Offset 316, 9 lines modifiedOffset 316, 9 lines modified
316 ······proxy·that·you·can·attach·your·own·proxies·to.316 ······proxy·that·you·can·attach·your·own·proxies·to.
317 ····*·use·a·ban·avoidance·service,·such·as·_\x8Z_\x8y_\x8t_\x8e_\x8·_\x8A_\x8P_\x8I,·which·provides·a·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y317 ····*·use·a·ban·avoidance·service,·such·as·_\x8Z_\x8y_\x8t_\x8e_\x8·_\x8A_\x8P_\x8I,·which·provides·a·_\x8S_\x8c_\x8r_\x8a_\x8p_\x8y
318 ······_\x8p_\x8l_\x8u_\x8g_\x8i_\x8n·and·additional·features,·like·_\x8A_\x8I_\x8·_\x8w_\x8e_\x8b_\x8·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8i_\x8n_\x8g318 ······_\x8p_\x8l_\x8u_\x8g_\x8i_\x8n·and·additional·features,·like·_\x8A_\x8I_\x8·_\x8w_\x8e_\x8b_\x8·_\x8s_\x8c_\x8r_\x8a_\x8p_\x8i_\x8n_\x8g
319 If·you·are·still·unable·to·prevent·your·bot·getting·banned,·consider·contacting319 If·you·are·still·unable·to·prevent·your·bot·getting·banned,·consider·contacting
320 _\x8c_\x8o_\x8m_\x8m_\x8e_\x8r_\x8c_\x8i_\x8a_\x8l_\x8·_\x8s_\x8u_\x8p_\x8p_\x8o_\x8r_\x8t.320 _\x8c_\x8o_\x8m_\x8m_\x8e_\x8r_\x8c_\x8i_\x8a_\x8l_\x8·_\x8s_\x8u_\x8p_\x8p_\x8o_\x8r_\x8t.
321 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t321 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
322 ===============================================================================322 ===============================================================================
323 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.323 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
324 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.324 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.67 KB
./usr/share/doc/python-scrapy-doc/html/topics/request-response.html
    
Offset 1686, 15 lines modifiedOffset 1686, 15 lines modified
1686 ········<a·href="link-extractors.html"·class="btn·btn-neutral·float-right"·title="Link·Extractors"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>1686 ········<a·href="link-extractors.html"·class="btn·btn-neutral·float-right"·title="Link·Extractors"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
1687 ····</div>1687 ····</div>
  
1688 ··<hr/>1688 ··<hr/>
  
1689 ··<div·role="contentinfo">1689 ··<div·role="contentinfo">
1690 ····<p>&#169;·Copyright·Scrapy·developers.1690 ····<p>&#169;·Copyright·Scrapy·developers.
1691 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.1691 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
1692 ······</span></p>1692 ······</span></p>
1693 ··</div>1693 ··</div>
  
1694 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a1694 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
1695 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>1695 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
1696 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.1696 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
1697 ···1697 ···
⊟
877 B
html2text {}
    
Offset 1061, 9 lines modifiedOffset 1061, 9 lines modified
1061 ······_\x8T_\x8e_\x8x_\x8t_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e_\x8._\x8e_\x8n_\x8c_\x8o_\x8d_\x8i_\x8n_\x8g.1061 ······_\x8T_\x8e_\x8x_\x8t_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e_\x8._\x8e_\x8n_\x8c_\x8o_\x8d_\x8i_\x8n_\x8g.
1062 *\x8**\x8**\x8**\x8*·J\x8Js\x8so\x8on\x8nR\x8Re\x8es\x8sp\x8po\x8on\x8ns\x8se\x8e·o\x8ob\x8bj\x8je\x8ec\x8ct\x8ts\x8s_\x8?\x8·*\x8**\x8**\x8**\x8*1062 *\x8**\x8**\x8**\x8*·J\x8Js\x8so\x8on\x8nR\x8Re\x8es\x8sp\x8po\x8on\x8ns\x8se\x8e·o\x8ob\x8bj\x8je\x8ec\x8ct\x8ts\x8s_\x8?\x8·*\x8**\x8**\x8**\x8*
1063 ··c\x8cl\x8la\x8as\x8ss\x8s·scrapy.http.JsonResponse(u\x8ur\x8rl\x8l[,·.\x8..\x8..\x8.])_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x81063 ··c\x8cl\x8la\x8as\x8ss\x8s·scrapy.http.JsonResponse(u\x8ur\x8rl\x8l[,·.\x8..\x8..\x8.])_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x8
1064 ······The·_\x8J_\x8s_\x8o_\x8n_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e·class·is·a·subclass·of·_\x8T_\x8e_\x8x_\x8t_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e·that·is·used·when1064 ······The·_\x8J_\x8s_\x8o_\x8n_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e·class·is·a·subclass·of·_\x8T_\x8e_\x8x_\x8t_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e·that·is·used·when
1065 ······the·response·has·a·_\x8J_\x8S_\x8O_\x8N_\x8·_\x8M_\x8I_\x8M_\x8E_\x8·_\x8t_\x8y_\x8p_\x8e·in·itsContent-Typeheader.1065 ······the·response·has·a·_\x8J_\x8S_\x8O_\x8N_\x8·_\x8M_\x8I_\x8M_\x8E_\x8·_\x8t_\x8y_\x8p_\x8e·in·itsContent-Typeheader.
1066 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t1066 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
1067 ===============================================================================1067 ===============================================================================
1068 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.1068 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
1069 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.1069 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.54 KB
./usr/share/doc/python-scrapy-doc/html/topics/scheduler.html
    
Offset 372, 15 lines modifiedOffset 372, 15 lines modified
372 ········<a·href="exporters.html"·class="btn·btn-neutral·float-right"·title="Item·Exporters"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>372 ········<a·href="exporters.html"·class="btn·btn-neutral·float-right"·title="Item·Exporters"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
373 ····</div>373 ····</div>
  
374 ··<hr/>374 ··<hr/>
  
375 ··<div·role="contentinfo">375 ··<div·role="contentinfo">
376 ····<p>&#169;·Copyright·Scrapy·developers.376 ····<p>&#169;·Copyright·Scrapy·developers.
377 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.377 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
378 ······</span></p>378 ······</span></p>
379 ··</div>379 ··</div>
  
380 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a380 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
381 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>381 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
382 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.382 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
383 ···383 ···
⊟
772 B
html2text {}
    
Offset 205, 9 lines modifiedOffset 205, 9 lines modified
205 ········open(s\x8sp\x8pi\x8id\x8de\x8er\x8r:\x8:·_\x8S\x8S_\x8p\x8p_\x8i\x8i_\x8d\x8d_\x8e\x8e_\x8r\x8r)·→·_\x8D_\x8e_\x8f_\x8e_\x8r_\x8r_\x8e_\x8d[_\x8N_\x8o_\x8n_\x8e]·|·_\x8N_\x8o_\x8n_\x8e_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x8205 ········open(s\x8sp\x8pi\x8id\x8de\x8er\x8r:\x8:·_\x8S\x8S_\x8p\x8p_\x8i\x8i_\x8d\x8d_\x8e\x8e_\x8r\x8r)·→·_\x8D_\x8e_\x8f_\x8e_\x8r_\x8r_\x8e_\x8d[_\x8N_\x8o_\x8n_\x8e]·|·_\x8N_\x8o_\x8n_\x8e_\x8[_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e_\x8]_\x8
206 ···············1.·initialize·the·memory·queue206 ···············1.·initialize·the·memory·queue
207 ···············2.·initialize·the·disk·queue·if·the·jobdir·attribute·is·a·valid207 ···············2.·initialize·the·disk·queue·if·the·jobdir·attribute·is·a·valid
208 ··················directory208 ··················directory
209 ···············3.·return·the·result·of·the·dupefilter’s·open·method209 ···············3.·return·the·result·of·the·dupefilter’s·open·method
210 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t210 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
211 ===============================================================================211 ===============================================================================
212 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.212 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
213 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.213 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.38 KB
./usr/share/doc/python-scrapy-doc/html/topics/scrapyd.html
    
Offset 159, 15 lines modifiedOffset 159, 15 lines modified
159 ··········</div>159 ··········</div>
160 ··········<footer>160 ··········<footer>
  
161 ··<hr/>161 ··<hr/>
  
162 ··<div·role="contentinfo">162 ··<div·role="contentinfo">
163 ····<p>&#169;·Copyright·Scrapy·developers.163 ····<p>&#169;·Copyright·Scrapy·developers.
164 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.164 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
165 ······</span></p>165 ······</span></p>
166 ··</div>166 ··</div>
  
167 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a167 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
168 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>168 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
169 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.169 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
170 ···170 ···
⊟
774 B
html2text {}
    
Offset 59, 9 lines modifiedOffset 59, 9 lines modified
59 ····*·_\x8V_\x8i_\x8e_\x8w_\x8·_\x8p_\x8a_\x8g_\x8e_\x8·_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e59 ····*·_\x8V_\x8i_\x8e_\x8w_\x8·_\x8p_\x8a_\x8g_\x8e_\x8·_\x8s_\x8o_\x8u_\x8r_\x8c_\x8e
60 ===============================================================================60 ===============================================================================
61 *\x8**\x8**\x8**\x8**\x8**\x8*·S\x8Sc\x8cr\x8ra\x8ap\x8py\x8yd\x8d_\x8?\x8·*\x8**\x8**\x8**\x8**\x8**\x8*61 *\x8**\x8**\x8**\x8**\x8**\x8*·S\x8Sc\x8cr\x8ra\x8ap\x8py\x8yd\x8d_\x8?\x8·*\x8**\x8**\x8**\x8**\x8**\x8*
62 Scrapyd·has·been·moved·into·a·separate·project.62 Scrapyd·has·been·moved·into·a·separate·project.
63 Its·documentation·is·now·hosted·at:63 Its·documentation·is·now·hosted·at:
64 ·····_\x8h_\x8t_\x8t_\x8p_\x8s_\x8:_\x8/_\x8/_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8d_\x8._\x8r_\x8e_\x8a_\x8d_\x8t_\x8h_\x8e_\x8d_\x8o_\x8c_\x8s_\x8._\x8i_\x8o_\x8/_\x8e_\x8n_\x8/_\x8l_\x8a_\x8t_\x8e_\x8s_\x8t_\x8/64 ·····_\x8h_\x8t_\x8t_\x8p_\x8s_\x8:_\x8/_\x8/_\x8s_\x8c_\x8r_\x8a_\x8p_\x8y_\x8d_\x8._\x8r_\x8e_\x8a_\x8d_\x8t_\x8h_\x8e_\x8d_\x8o_\x8c_\x8s_\x8._\x8i_\x8o_\x8/_\x8e_\x8n_\x8/_\x8l_\x8a_\x8t_\x8e_\x8s_\x8t_\x8/
65 ===============================================================================65 ===============================================================================
66 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.66 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
67 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.67 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.44 KB
./usr/share/doc/python-scrapy-doc/html/topics/selectors.html
    
Offset 1376, 15 lines modifiedOffset 1376, 15 lines modified
1376 ········<a·href="items.html"·class="btn·btn-neutral·float-right"·title="Items"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>1376 ········<a·href="items.html"·class="btn·btn-neutral·float-right"·title="Items"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
1377 ····</div>1377 ····</div>
  
1378 ··<hr/>1378 ··<hr/>
  
1379 ··<div·role="contentinfo">1379 ··<div·role="contentinfo">
1380 ····<p>&#169;·Copyright·Scrapy·developers.1380 ····<p>&#169;·Copyright·Scrapy·developers.
1381 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.1381 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
1382 ······</span></p>1382 ······</span></p>
1383 ··</div>1383 ··</div>
  
1384 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a1384 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
1385 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>1385 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
1386 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.1386 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
1387 ···1387 ···
⊟
674 B
html2text {}
    
Offset 943, 9 lines modifiedOffset 943, 9 lines modified
943 ······sel.xpath("//product")943 ······sel.xpath("//product")
944 ···2.·Extract·all·prices·from·a·_\x8G_\x8o_\x8o_\x8g_\x8l_\x8e_\x8·_\x8B_\x8a_\x8s_\x8e_\x8·_\x8X_\x8M_\x8L_\x8·_\x8f_\x8e_\x8e_\x8d·which·requires·registering944 ···2.·Extract·all·prices·from·a·_\x8G_\x8o_\x8o_\x8g_\x8l_\x8e_\x8·_\x8B_\x8a_\x8s_\x8e_\x8·_\x8X_\x8M_\x8L_\x8·_\x8f_\x8e_\x8e_\x8d·which·requires·registering
945 ······a·namespace:945 ······a·namespace:
946 ······sel.register_namespace("g",·"http://base.google.com/ns/1.0")946 ······sel.register_namespace("g",·"http://base.google.com/ns/1.0")
947 ······sel.xpath("//g:price").getall()947 ······sel.xpath("//g:price").getall()
948 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t948 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
949 ===============================================================================949 ===============================================================================
950 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.950 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
951 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.951 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.48 KB
./usr/share/doc/python-scrapy-doc/html/topics/settings.html
    
Offset 1673, 15 lines modifiedOffset 1673, 15 lines modified
1673 ········<a·href="exceptions.html"·class="btn·btn-neutral·float-right"·title="Exceptions"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>1673 ········<a·href="exceptions.html"·class="btn·btn-neutral·float-right"·title="Exceptions"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
1674 ····</div>1674 ····</div>
  
1675 ··<hr/>1675 ··<hr/>
  
1676 ··<div·role="contentinfo">1676 ··<div·role="contentinfo">
1677 ····<p>&#169;·Copyright·Scrapy·developers.1677 ····<p>&#169;·Copyright·Scrapy·developers.
1678 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.1678 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
1679 ······</span></p>1679 ······</span></p>
1680 ··</div>1680 ··</div>
  
1681 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a1681 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
1682 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>1682 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
1683 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.1683 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
1684 ···1684 ···
⊟
711 B
html2text {}
    
Offset 1177, 9 lines modifiedOffset 1177, 9 lines modified
1177 ····*·_\x8R_\x8E_\x8T_\x8R_\x8Y_\x8__\x8T_\x8I_\x8M_\x8E_\x8S1177 ····*·_\x8R_\x8E_\x8T_\x8R_\x8Y_\x8__\x8T_\x8I_\x8M_\x8E_\x8S
1178 ····*·_\x8T_\x8E_\x8L_\x8N_\x8E_\x8T_\x8C_\x8O_\x8N_\x8S_\x8O_\x8L_\x8E_\x8__\x8H_\x8O_\x8S_\x8T1178 ····*·_\x8T_\x8E_\x8L_\x8N_\x8E_\x8T_\x8C_\x8O_\x8N_\x8S_\x8O_\x8L_\x8E_\x8__\x8H_\x8O_\x8S_\x8T
1179 ····*·_\x8T_\x8E_\x8L_\x8N_\x8E_\x8T_\x8C_\x8O_\x8N_\x8S_\x8O_\x8L_\x8E_\x8__\x8P_\x8A_\x8S_\x8S_\x8W_\x8O_\x8R_\x8D1179 ····*·_\x8T_\x8E_\x8L_\x8N_\x8E_\x8T_\x8C_\x8O_\x8N_\x8S_\x8O_\x8L_\x8E_\x8__\x8P_\x8A_\x8S_\x8S_\x8W_\x8O_\x8R_\x8D
1180 ····*·_\x8T_\x8E_\x8L_\x8N_\x8E_\x8T_\x8C_\x8O_\x8N_\x8S_\x8O_\x8L_\x8E_\x8__\x8P_\x8O_\x8R_\x8T1180 ····*·_\x8T_\x8E_\x8L_\x8N_\x8E_\x8T_\x8C_\x8O_\x8N_\x8S_\x8O_\x8L_\x8E_\x8__\x8P_\x8O_\x8R_\x8T
1181 ····*·_\x8T_\x8E_\x8L_\x8N_\x8E_\x8T_\x8C_\x8O_\x8N_\x8S_\x8O_\x8L_\x8E_\x8__\x8U_\x8S_\x8E_\x8R_\x8N_\x8A_\x8M_\x8E1181 ····*·_\x8T_\x8E_\x8L_\x8N_\x8E_\x8T_\x8C_\x8O_\x8N_\x8S_\x8O_\x8L_\x8E_\x8__\x8U_\x8S_\x8E_\x8R_\x8N_\x8A_\x8M_\x8E
1182 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t1182 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
1183 ===============================================================================1183 ===============================================================================
1184 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.1184 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
1185 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.1185 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.4 KB
./usr/share/doc/python-scrapy-doc/html/topics/shell.html
    
Offset 432, 15 lines modifiedOffset 432, 15 lines modified
432 ········<a·href="item-pipeline.html"·class="btn·btn-neutral·float-right"·title="Item·Pipeline"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>432 ········<a·href="item-pipeline.html"·class="btn·btn-neutral·float-right"·title="Item·Pipeline"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
433 ····</div>433 ····</div>
  
434 ··<hr/>434 ··<hr/>
  
435 ··<div·role="contentinfo">435 ··<div·role="contentinfo">
436 ····<p>&#169;·Copyright·Scrapy·developers.436 ····<p>&#169;·Copyright·Scrapy·developers.
437 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.437 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
438 ······</span></p>438 ······</span></p>
439 ··</div>439 ··</div>
  
440 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a440 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
441 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>441 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
442 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.442 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
443 ···443 ···
⊟
635 B
html2text {}
    
Offset 279, 9 lines modifiedOffset 279, 9 lines modified
279 example.net>·(referer:·None)279 example.net>·(referer:·None)
280 ...280 ...
281 Note·that·you·can’t·use·the·fetch·shortcut·here·since·the·Scrapy·engine·is281 Note·that·you·can’t·use·the·fetch·shortcut·here·since·the·Scrapy·engine·is
282 blocked·by·the·shell.·However,·after·you·leave·the·shell,·the·spider·will282 blocked·by·the·shell.·However,·after·you·leave·the·shell,·the·spider·will
283 continue·crawling·where·it·stopped,·as·shown·above.283 continue·crawling·where·it·stopped,·as·shown·above.
284 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t284 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
285 ===============================================================================285 ===============================================================================
286 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.286 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
287 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.287 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.51 KB
./usr/share/doc/python-scrapy-doc/html/topics/signals.html
    
Offset 715, 15 lines modifiedOffset 715, 15 lines modified
715 ········<a·href="scheduler.html"·class="btn·btn-neutral·float-right"·title="Scheduler"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>715 ········<a·href="scheduler.html"·class="btn·btn-neutral·float-right"·title="Scheduler"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
716 ····</div>716 ····</div>
  
717 ··<hr/>717 ··<hr/>
  
718 ··<div·role="contentinfo">718 ··<div·role="contentinfo">
719 ····<p>&#169;·Copyright·Scrapy·developers.719 ····<p>&#169;·Copyright·Scrapy·developers.
720 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.720 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
721 ······</span></p>721 ······</span></p>
722 ··</div>722 ··</div>
  
723 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a723 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
724 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>724 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
725 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.725 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
726 ···726 ···
⊟
752 B
html2text {}
    
Offset 392, 9 lines modifiedOffset 392, 9 lines modified
392 ················*·r\x8re\x8es\x8sp\x8po\x8on\x8ns\x8se\x8e·(_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e·object)·–·the·response·downloaded392 ················*·r\x8re\x8es\x8sp\x8po\x8on\x8ns\x8se\x8e·(_\x8R_\x8e_\x8s_\x8p_\x8o_\x8n_\x8s_\x8e·object)·–·the·response·downloaded
393 ················*·r\x8re\x8eq\x8qu\x8ue\x8es\x8st\x8t·(Request·object)·–·the·request·that·generated·the393 ················*·r\x8re\x8eq\x8qu\x8ue\x8es\x8st\x8t·(Request·object)·–·the·request·that·generated·the
394 ··················response394 ··················response
395 ················*·s\x8sp\x8pi\x8id\x8de\x8er\x8r·(_\x8S_\x8p_\x8i_\x8d_\x8e_\x8r·object)·–·the·spider·for·which·the·response·is395 ················*·s\x8sp\x8pi\x8id\x8de\x8er\x8r·(_\x8S_\x8p_\x8i_\x8d_\x8e_\x8r·object)·–·the·spider·for·which·the·response·is
396 ··················intended396 ··················intended
397 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t397 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
398 ===============================================================================398 ===============================================================================
399 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.399 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
400 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.400 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.55 KB
./usr/share/doc/python-scrapy-doc/html/topics/spider-middleware.html
    
Offset 686, 15 lines modifiedOffset 686, 15 lines modified
686 ········<a·href="extensions.html"·class="btn·btn-neutral·float-right"·title="Extensions"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>686 ········<a·href="extensions.html"·class="btn·btn-neutral·float-right"·title="Extensions"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
687 ····</div>687 ····</div>
  
688 ··<hr/>688 ··<hr/>
  
689 ··<div·role="contentinfo">689 ··<div·role="contentinfo">
690 ····<p>&#169;·Copyright·Scrapy·developers.690 ····<p>&#169;·Copyright·Scrapy·developers.
691 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.691 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
692 ······</span></p>692 ······</span></p>
693 ··</div>693 ··</div>
  
694 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a694 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
695 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>695 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
696 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.696 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
697 ···697 ···
⊟
769 B
html2text {}
    
Offset 402, 9 lines modifiedOffset 402, 9 lines modified
402 ······Filters·out·requests·with·URLs·longer·than·URLLENGTH_LIMIT402 ······Filters·out·requests·with·URLs·longer·than·URLLENGTH_LIMIT
403 ······The·_\x8U_\x8r_\x8l_\x8L_\x8e_\x8n_\x8g_\x8t_\x8h_\x8M_\x8i_\x8d_\x8d_\x8l_\x8e_\x8w_\x8a_\x8r_\x8e·can·be·configured·through·the·following·settings403 ······The·_\x8U_\x8r_\x8l_\x8L_\x8e_\x8n_\x8g_\x8t_\x8h_\x8M_\x8i_\x8d_\x8d_\x8l_\x8e_\x8w_\x8a_\x8r_\x8e·can·be·configured·through·the·following·settings
404 ······(see·the·settings·documentation·for·more·info):404 ······(see·the·settings·documentation·for·more·info):
405 ···············*·_\x8U_\x8R_\x8L_\x8L_\x8E_\x8N_\x8G_\x8T_\x8H_\x8__\x8L_\x8I_\x8M_\x8I_\x8T·-·The·maximum·URL·length·to·allow·for405 ···············*·_\x8U_\x8R_\x8L_\x8L_\x8E_\x8N_\x8G_\x8T_\x8H_\x8__\x8L_\x8I_\x8M_\x8I_\x8T·-·The·maximum·URL·length·to·allow·for
406 ·················crawled·URLs.406 ·················crawled·URLs.
407 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t407 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
408 ===============================================================================408 ===============================================================================
409 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.409 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
410 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.410 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.33 KB
./usr/share/doc/python-scrapy-doc/html/topics/spiders.html
    
Offset 1140, 15 lines modifiedOffset 1140, 15 lines modified
1140 ········<a·href="selectors.html"·class="btn·btn-neutral·float-right"·title="Selectors"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>1140 ········<a·href="selectors.html"·class="btn·btn-neutral·float-right"·title="Selectors"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
1141 ····</div>1141 ····</div>
  
1142 ··<hr/>1142 ··<hr/>
  
1143 ··<div·role="contentinfo">1143 ··<div·role="contentinfo">
1144 ····<p>&#169;·Copyright·Scrapy·developers.1144 ····<p>&#169;·Copyright·Scrapy·developers.
1145 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.1145 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
1146 ······</span></p>1146 ······</span></p>
1147 ··</div>1147 ··</div>
  
1148 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a1148 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
1149 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>1149 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
1150 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.1150 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
1151 ···1151 ···
⊟
558 B
html2text {}
    
Offset 780, 9 lines modifiedOffset 780, 9 lines modified
780 ····def·parse_shop(self,·response):780 ····def·parse_shop(self,·response):
781 ········pass··#·...·scrape·shop·here·...781 ········pass··#·...·scrape·shop·here·...
  
782 ····def·parse_other(self,·response):782 ····def·parse_other(self,·response):
783 ········pass··#·...·scrape·other·here·...783 ········pass··#·...·scrape·other·here·...
784 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t784 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
785 ===============================================================================785 ===============================================================================
786 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.786 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
787 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.787 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.54 KB
./usr/share/doc/python-scrapy-doc/html/topics/stats.html
    
Offset 269, 15 lines modifiedOffset 269, 15 lines modified
269 ········<a·href="email.html"·class="btn·btn-neutral·float-right"·title="Sending·e-mail"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>269 ········<a·href="email.html"·class="btn·btn-neutral·float-right"·title="Sending·e-mail"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
270 ····</div>270 ····</div>
  
271 ··<hr/>271 ··<hr/>
  
272 ··<div·role="contentinfo">272 ··<div·role="contentinfo">
273 ····<p>&#169;·Copyright·Scrapy·developers.273 ····<p>&#169;·Copyright·Scrapy·developers.
274 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.274 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
275 ······</span></p>275 ······</span></p>
276 ··</div>276 ··</div>
  
277 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a277 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
278 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>278 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
279 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.279 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
280 ···280 ···
⊟
785 B
html2text {}
    
Offset 126, 9 lines modifiedOffset 126, 9 lines modified
126 ······A·Stats·collector·which·does·nothing·but·is·very·efficient·(because·it126 ······A·Stats·collector·which·does·nothing·but·is·very·efficient·(because·it
127 ······does·nothing).·This·stats·collector·can·be·set·via·the·_\x8S_\x8T_\x8A_\x8T_\x8S_\x8__\x8C_\x8L_\x8A_\x8S_\x8S127 ······does·nothing).·This·stats·collector·can·be·set·via·the·_\x8S_\x8T_\x8A_\x8T_\x8S_\x8__\x8C_\x8L_\x8A_\x8S_\x8S
128 ······setting,·to·disable·stats·collect·in·order·to·improve·performance.128 ······setting,·to·disable·stats·collect·in·order·to·improve·performance.
129 ······However,·the·performance·penalty·of·stats·collection·is·usually·marginal129 ······However,·the·performance·penalty·of·stats·collection·is·usually·marginal
130 ······compared·to·other·Scrapy·workload·like·parsing·pages.130 ······compared·to·other·Scrapy·workload·like·parsing·pages.
131 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t131 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
132 ===============================================================================132 ===============================================================================
133 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.133 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
134 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.134 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.43 KB
./usr/share/doc/python-scrapy-doc/html/topics/telnetconsole.html
    
Offset 368, 15 lines modifiedOffset 368, 15 lines modified
368 ········<a·href="../faq.html"·class="btn·btn-neutral·float-right"·title="Frequently·Asked·Questions"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>368 ········<a·href="../faq.html"·class="btn·btn-neutral·float-right"·title="Frequently·Asked·Questions"·accesskey="n"·rel="next">Next·<span·class="fa·fa-arrow-circle-right"·aria-hidden="true"></span></a>
369 ····</div>369 ····</div>
  
370 ··<hr/>370 ··<hr/>
  
371 ··<div·role="contentinfo">371 ··<div·role="contentinfo">
372 ····<p>&#169;·Copyright·Scrapy·developers.372 ····<p>&#169;·Copyright·Scrapy·developers.
373 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.373 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
374 ······</span></p>374 ······</span></p>
375 ··</div>375 ··</div>
  
376 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a376 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
377 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>377 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
378 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.378 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
379 ···379 ···
⊟
642 B
html2text {}
    
Offset 182, 9 lines modifiedOffset 182, 9 lines modified
182 The·username·used·for·the·telnet·console182 The·username·used·for·the·telnet·console
183 *\x8**\x8**\x8**\x8*·T\x8TE\x8EL\x8LN\x8NE\x8ET\x8TC\x8CO\x8ON\x8NS\x8SO\x8OL\x8LE\x8E_\x8_P\x8PA\x8AS\x8SS\x8SW\x8WO\x8OR\x8RD\x8D_\x8?\x8·*\x8**\x8**\x8**\x8*183 *\x8**\x8**\x8**\x8*·T\x8TE\x8EL\x8LN\x8NE\x8ET\x8TC\x8CO\x8ON\x8NS\x8SO\x8OL\x8LE\x8E_\x8_P\x8PA\x8AS\x8SS\x8SW\x8WO\x8OR\x8RD\x8D_\x8?\x8·*\x8**\x8**\x8**\x8*
184 Default:·None184 Default:·None
185 The·password·used·for·the·telnet·console,·default·behaviour·is·to·have·it185 The·password·used·for·the·telnet·console,·default·behaviour·is·to·have·it
186 autogenerated186 autogenerated
187 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t187 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s·_\x8N_\x8e_\x8x_\x8t
188 ===============================================================================188 ===============================================================================
189 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.189 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
190 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.190 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
⊟
1.4 KB
./usr/share/doc/python-scrapy-doc/html/versioning.html
    
Offset 209, 15 lines modifiedOffset 209, 15 lines modified
209 ········<a·href="contributing.html"·class="btn·btn-neutral·float-left"·title="Contributing·to·Scrapy"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>209 ········<a·href="contributing.html"·class="btn·btn-neutral·float-left"·title="Contributing·to·Scrapy"·accesskey="p"·rel="prev"><span·class="fa·fa-arrow-circle-left"·aria-hidden="true"></span>·Previous</a>
210 ····</div>210 ····</div>
  
211 ··<hr/>211 ··<hr/>
  
212 ··<div·role="contentinfo">212 ··<div·role="contentinfo">
213 ····<p>&#169;·Copyright·Scrapy·developers.213 ····<p>&#169;·Copyright·Scrapy·developers.
214 ······<span·class="lastupdated">Last·updated·on·Nov·18,·2024.214 ······<span·class="lastupdated">Last·updated·on·Nov·19,·2024.
215 ······</span></p>215 ······</span></p>
216 ··</div>216 ··</div>
  
217 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a217 ··Built·with·<a·href="https://www.sphinx-doc.org/">Sphinx</a>·using·a
218 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>218 ····<a·href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
219 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.219 ····provided·by·<a·href="https://readthedocs.org">Read·the·Docs</a>.
220 ···220 ···
⊟
627 B
html2text {}
    
Offset 95, 9 lines modifiedOffset 95, 9 lines modified
95 14th·2021·or·before·that.95 14th·2021·or·before·that.
96 Any·new·Scrapy·release·after·a·year·m\x8ma\x8ay\x8y·remove·support·for·that·deprecated96 Any·new·Scrapy·release·after·a·year·m\x8ma\x8ay\x8y·remove·support·for·that·deprecated
97 feature.97 feature.
98 All·deprecated·features·removed·in·a·Scrapy·release·are·explicitly·mentioned·in98 All·deprecated·features·removed·in·a·Scrapy·release·are·explicitly·mentioned·in
99 the·_\x8r_\x8e_\x8l_\x8e_\x8a_\x8s_\x8e_\x8·_\x8n_\x8o_\x8t_\x8e_\x8s.99 the·_\x8r_\x8e_\x8l_\x8e_\x8a_\x8s_\x8e_\x8·_\x8n_\x8o_\x8t_\x8e_\x8s.
100 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s100 _\x8P_\x8r_\x8e_\x8v_\x8i_\x8o_\x8u_\x8s
101 ===============================================================================101 ===============================================================================
102 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·18,·2024.102 ©·Copyright·Scrapy·developers.·Last·updated·on·Nov·19,·2024.
103 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.103 Built·with·_\x8S_\x8p_\x8h_\x8i_\x8n_\x8x·using·a·_\x8t_\x8h_\x8e_\x8m_\x8e·provided·by·_\x8R_\x8e_\x8a_\x8d_\x8·_\x8t_\x8h_\x8e_\x8·_\x8D_\x8o_\x8c_\x8s.
Generated by diffoscope 284