How to Block 360Spider (the web robot)

rage image by http://www.flickr.com/photos/istolethetv/

360Spider was once again TOO demanding

I draw the line at webrobots that frequently morph their user agent names. Spider360 really got out of control today.

Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.8.0.11) Gecko/20070312 Firefox/1.5.0.11; 360Spider

Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; MDDR; .NET4.0C; .NET4.0E; .NET CLR 1.1.4322; Tablet PC 2.0); 360Spider

Blocked with StreamCatcher

I blocked the bot using StreamCatcher ISAPI Filter for IIS.
Two configuration changes were required.

[SCWebSiteConfig_wwwMySite.cfg]
-----------------------------------------------------
StreamCatcher WebSite Configuration File for wwwMySite
-----------------------------------------------------

[wwwMySite.Settings]
(snip)
UserAgentBlocking=Enabled

 
[wwwMySite.UserAgentsToBlock]
1={..}360Spider{..}

Then IISRESET, test with Firefox and User Agent Switcher to make sure it worked.... now all requests from any user agent containing 360Spider will receive NoResponse nada nothing http connection times out.

How to Block for ALL WebSites

Work at the Master configuration level.

SCConfig_Master.cfg

[GlobalSettings]
UserAgentBlocking=Enabled

[UserAgentsToBlockForAllWebSites]
1={..}360Spider{..}

Have a better day.

Comments

Installing Firebird 2.5 64-bit on CentOS 6.2

Media: burn DVD with disk #1 of CentOS 6.2 installer

Boot to the DVD

During installation, from the radio button list, select Database Server (and later turn off the 4 default database choices)
Unselect a few things that seem unnecessary, like debugging features and php
Select all the Desktop options, plus X Windows

Create one user with a secure password; that user will have a GUI (KDE). Advice: use an uncommon name for your user.

After the dust settles, sort out networking. The GUI has a feature for that, System > Preferences > Network. ETH1 is the 2nd cat5 network jack. ETH0 is the 1st one (left to right, looking at the back of the SuperMicro 1u server). Fill in the MANUAL settings to fix the ip, and make sure to check the box [x] connect automatically.

Test the network by opening Applications> System Tools > Konsole.

cd /sbin
./ifconfig

That will show you what is running on ETH1 and it should include your static ip number.

Now, System > Administration > Firewall…

Medium IE Security through Group Policy for QuickBooks 2018 Desktop on Windows 2016 Server on AWS EC2

Regarding error message, "Internet Security Levels Are Set Too High," in QuickBooks Desktop 2018, running on Win Server 2018 on AWS EC2, how can IE be made compatible?

[ Intuit erased my 25-Nov-2017 post on their forum. Thanks to google cache, I am reposting my original question plus a summary of my resolution here ]

The advice on https://community.intuit.com/questions/1637443 does not help.

On my system, the IE feature for changing the security level to "Medium" is greyed out - disabled - not available for use.

I have TLS 1.2 checked under Advanced Security in the IE Options. I have added https://*.intuit.com and https://*.quickbooks.com to the list of Trusted Sites.

Unfortunately for its own help pages, QB wants to display content from intu-help-qb11:// and there is no obvious way to add that address to the list of trusted sites in IE because the prefix is not recognized as a valid protocol.

Please note that this error happens when connected over Remote Desktop rega…

Windows 10 upgrade success after error 0x80070070 - 0x2000C

This post documents one way to successfully get past error 0x80070070 - 0x2000C with the Windows 10 upgrade process. Your mileage may vary.

First, the problem. I used the Media Creation tool to make an ISO and cleared enough disk space that the installation from ISO was willing to proceed. I had started from a Windows 7 Pro system, and I used Virtual Clone Drive to mount the ISO. I was also running this machine inside VirtualBox and had to uninstall the Guest Additions and change the machine type to Windows 10. All that worked. The problem was that after the Win10 upgrade was in process and in fact almost complete, it reverted itself with an error message:

We couldn't install Windows 10
We've set your PC back to the way it ws right before you started installing Windows 10.

0x80070070 - 0x2000C
The installation failed in the SAFE_OS phase with an error during APPLY_IMAGE operation.

After some research, I found two potentially valid reasons for the trouble. 1, possibly corru…

Web Tips, Etc.

Search This Blog