+- Atozed Forums (https://www.atozed.com/forums)
+-- Forum: Atozed Software Products (https://www.atozed.com/forums/forum-1.html)
+--- Forum: IntraWeb (https://www.atozed.com/forums/forum-3.html)
+---- Forum: English (https://www.atozed.com/forums/forum-16.html)
+----- Forum: IntraWeb General Discussion (https://www.atozed.com/forums/forum-4.html)
+----- Thread: Crawling website 405 (/thread-1430.html)
Crawling website 405 - Anto90 - 12-11-2019
Hi,
for crawling our website we use a component called aimysitemap. We have an outer part in joomla and the inner part made with intraweb. When the component tries to scan the various links that make up the site I get a http 405 only for links of the type www.mysite.com/exec/isapi.dll (there are also some handlers). I tried in the servercontroller to enable the SessionOptions.AllowSearchEngine = True and HttpMethods properties by flagging all three protocols but the result does not change.
Is there any other option to set? I enclose a screenshot of the error. It would seem that intraweb replied with a 405 when the component tries to scan the file.
Thanks
Andrea
RE: Crawling website 405 - Alexandre Machado - 12-12-2019
What kind of request is that? GET and POST are enabled by default. 405 is only returned by IW when method is not allowed
RE: Crawling website 405 - Anto90 - 12-12-2019
(12-12-2019, 12:43 AM)Alexandre Machado Wrote: What kind of request is that? GET and POST are enabled by default. 405 is only returned by IW when method is not allowed
Hi,
I wrote to the component's manufacturer to find out what kind of http request is being made to scan the pages. As soon as I hear from you, I'll let you know. However, this has happened since we upgraded from the intraweb version 14.1.14 to 15.1.8. In fact in the previous versions it didn't happen. This creates problems for us as we should change component to achieve the same result.
P.S. Eventually there is a way to understand for yourself what kind of request it makes? (It is a joomla component)
Cheers
Andrea
RE: Crawling website 405 - Anto90 - 12-12-2019
(12-12-2019, 08:48 AM)Anto90 Wrote:They tell me that the component uses HEAD / HTTP/1.0 ( un http head request). I Enable the hmHead in ServerController but no result.(12-12-2019, 12:43 AM)Alexandre Machado Wrote: What kind of request is that? GET and POST are enabled by default. 405 is only returned by IW when method is not allowed
Andrea.
RE: Crawling website 405 - zohair - 08-07-2020
any update on this post, We are having the same issue with ver 15.1.22
RE: Crawling website 405 - zohair - 08-10-2020
will be great if we have a solution for this otherwise we will have to revert back to 14 where it was working fine.