test & tea : itsec testing, manual vs automated

17
IT Security testing: manual VS automated Zoltan Balazs, CTO @ MRG Effitas 2017

Upload: zoltan-balazs

Post on 22-Jan-2018

183 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Test & Tea : ITSEC testing, manual vs automated

IT Security testing manual VS automated

Zoltan Balazs CTO MRG Effitas

2017

Whoami

bull Irsquom NOT a CEH

bull Creator of the Zombie Browser ToolkithttpsgithubcomZ6543ZombieBrowserPack

bull Creator of the HWFW Bypass tool

bull Idea later() implemented by nation state attackers in Duqu 20httpsgithubcomMRGEffitashwfwbypass

bull Creator of the Malware Analysis Sandbox Tester toolhttpsgithubcomMRGEffitasSandbox_tester

bull Played with crappy IoT deviceshttpsjumpespjumpblogspothu201509how-i-hacked-my-ip-camera-and-foundhtml

httpsjumpespjumpblogspothu201508how-to-secure-your-home-againsthtml

Introduction

There is a saying that every software and system will be tested from a security point of view but the question is whether the owner controls when this is done and who reads the report

But the owner (or the users) will pay the price either way

Automated testing

Good at scanning multiple pages multiple parameters for the same issues

Bad at finding logical bugs authentication bypasses hellip

This is still an issue which is not found by automated scanners by default

What do you do

This is still an issue which is not found by automated scanners by default

What do you do

adminadmin

Automated scanners donrsquot brute-force user logins by default

This is still an issue which is not found by automated scanners

What do you do

This is still an issue which is not found by automated scanners

What do you do

Automated scanners donrsquot have a clue that they should try this parameter they have never seen before

What is the problem here

Is this found by scanners

loginphpusername=adminamppassword[$ne]=asdfg

array(username =gt adminpassword =gt array(rdquo$ne =gt asdfg))

Usually scanners donrsquot know NoSQL And if they know they are usually not that smart

ProTIP instead of asdfg use a long complex password so you can be sure this is not the correct password )

Try this challenge here

httpsplatformavataocomchallenges28f5fca5-6a01-11e6-bdf4-0800200c9a66

Automated scanners continued

Informational issue (not high medium low severity)

ldquoAn unknown service is running on TCP port 4444rdquo

What do you do

Automated scanners continued

Sample requestcodephpsrc=codephpamphl[0]=niceamphl[1]=textampmode=hl

Solution

Bypass whitelist by change order of parameters

php0816codephphl[0]=niceamphl[1]=textampmode=hlampsrc=solutionphp

Try it here

httpwwwwechallnetchallengephp0816indexphp

Conclusion

Use a good tool for boring repetitive tasks

And use your brain for creative hacks

And always develop new tools for new problems

Hack the planet

zoltanbalazsmrg-effitascom

httpshulinkedincominzbalazs

Twitter ndash zh4ck

wwwslidesharenetbz98

Check out avataocom to practice issues like this

Hackersuli meetup

Greetz to CrySySLab SpamAndHex

JumpESPJumpblogspotcom

Page 2: Test & Tea : ITSEC testing, manual vs automated

Whoami

bull Irsquom NOT a CEH

bull Creator of the Zombie Browser ToolkithttpsgithubcomZ6543ZombieBrowserPack

bull Creator of the HWFW Bypass tool

bull Idea later() implemented by nation state attackers in Duqu 20httpsgithubcomMRGEffitashwfwbypass

bull Creator of the Malware Analysis Sandbox Tester toolhttpsgithubcomMRGEffitasSandbox_tester

bull Played with crappy IoT deviceshttpsjumpespjumpblogspothu201509how-i-hacked-my-ip-camera-and-foundhtml

httpsjumpespjumpblogspothu201508how-to-secure-your-home-againsthtml

Introduction

There is a saying that every software and system will be tested from a security point of view but the question is whether the owner controls when this is done and who reads the report

But the owner (or the users) will pay the price either way

Automated testing

Good at scanning multiple pages multiple parameters for the same issues

Bad at finding logical bugs authentication bypasses hellip

This is still an issue which is not found by automated scanners by default

What do you do

This is still an issue which is not found by automated scanners by default

What do you do

adminadmin

Automated scanners donrsquot brute-force user logins by default

This is still an issue which is not found by automated scanners

What do you do

This is still an issue which is not found by automated scanners

What do you do

Automated scanners donrsquot have a clue that they should try this parameter they have never seen before

What is the problem here

Is this found by scanners

loginphpusername=adminamppassword[$ne]=asdfg

array(username =gt adminpassword =gt array(rdquo$ne =gt asdfg))

Usually scanners donrsquot know NoSQL And if they know they are usually not that smart

ProTIP instead of asdfg use a long complex password so you can be sure this is not the correct password )

Try this challenge here

httpsplatformavataocomchallenges28f5fca5-6a01-11e6-bdf4-0800200c9a66

Automated scanners continued

Informational issue (not high medium low severity)

ldquoAn unknown service is running on TCP port 4444rdquo

What do you do

Automated scanners continued

Sample requestcodephpsrc=codephpamphl[0]=niceamphl[1]=textampmode=hl

Solution

Bypass whitelist by change order of parameters

php0816codephphl[0]=niceamphl[1]=textampmode=hlampsrc=solutionphp

Try it here

httpwwwwechallnetchallengephp0816indexphp

Conclusion

Use a good tool for boring repetitive tasks

And use your brain for creative hacks

And always develop new tools for new problems

Hack the planet

zoltanbalazsmrg-effitascom

httpshulinkedincominzbalazs

Twitter ndash zh4ck

wwwslidesharenetbz98

Check out avataocom to practice issues like this

Hackersuli meetup

Greetz to CrySySLab SpamAndHex

JumpESPJumpblogspotcom

Page 3: Test & Tea : ITSEC testing, manual vs automated

Introduction

There is a saying that every software and system will be tested from a security point of view but the question is whether the owner controls when this is done and who reads the report

But the owner (or the users) will pay the price either way

Automated testing

Good at scanning multiple pages multiple parameters for the same issues

Bad at finding logical bugs authentication bypasses hellip

This is still an issue which is not found by automated scanners by default

What do you do

This is still an issue which is not found by automated scanners by default

What do you do

adminadmin

Automated scanners donrsquot brute-force user logins by default

This is still an issue which is not found by automated scanners

What do you do

This is still an issue which is not found by automated scanners

What do you do

Automated scanners donrsquot have a clue that they should try this parameter they have never seen before

What is the problem here

Is this found by scanners

loginphpusername=adminamppassword[$ne]=asdfg

array(username =gt adminpassword =gt array(rdquo$ne =gt asdfg))

Usually scanners donrsquot know NoSQL And if they know they are usually not that smart

ProTIP instead of asdfg use a long complex password so you can be sure this is not the correct password )

Try this challenge here

httpsplatformavataocomchallenges28f5fca5-6a01-11e6-bdf4-0800200c9a66

Automated scanners continued

Informational issue (not high medium low severity)

ldquoAn unknown service is running on TCP port 4444rdquo

What do you do

Automated scanners continued

Sample requestcodephpsrc=codephpamphl[0]=niceamphl[1]=textampmode=hl

Solution

Bypass whitelist by change order of parameters

php0816codephphl[0]=niceamphl[1]=textampmode=hlampsrc=solutionphp

Try it here

httpwwwwechallnetchallengephp0816indexphp

Conclusion

Use a good tool for boring repetitive tasks

And use your brain for creative hacks

And always develop new tools for new problems

Hack the planet

zoltanbalazsmrg-effitascom

httpshulinkedincominzbalazs

Twitter ndash zh4ck

wwwslidesharenetbz98

Check out avataocom to practice issues like this

Hackersuli meetup

Greetz to CrySySLab SpamAndHex

JumpESPJumpblogspotcom

Page 4: Test & Tea : ITSEC testing, manual vs automated

Automated testing

Good at scanning multiple pages multiple parameters for the same issues

Bad at finding logical bugs authentication bypasses hellip

This is still an issue which is not found by automated scanners by default

What do you do

This is still an issue which is not found by automated scanners by default

What do you do

adminadmin

Automated scanners donrsquot brute-force user logins by default

This is still an issue which is not found by automated scanners

What do you do

This is still an issue which is not found by automated scanners

What do you do

Automated scanners donrsquot have a clue that they should try this parameter they have never seen before

What is the problem here

Is this found by scanners

loginphpusername=adminamppassword[$ne]=asdfg

array(username =gt adminpassword =gt array(rdquo$ne =gt asdfg))

Usually scanners donrsquot know NoSQL And if they know they are usually not that smart

ProTIP instead of asdfg use a long complex password so you can be sure this is not the correct password )

Try this challenge here

httpsplatformavataocomchallenges28f5fca5-6a01-11e6-bdf4-0800200c9a66

Automated scanners continued

Informational issue (not high medium low severity)

ldquoAn unknown service is running on TCP port 4444rdquo

What do you do

Automated scanners continued

Sample requestcodephpsrc=codephpamphl[0]=niceamphl[1]=textampmode=hl

Solution

Bypass whitelist by change order of parameters

php0816codephphl[0]=niceamphl[1]=textampmode=hlampsrc=solutionphp

Try it here

httpwwwwechallnetchallengephp0816indexphp

Conclusion

Use a good tool for boring repetitive tasks

And use your brain for creative hacks

And always develop new tools for new problems

Hack the planet

zoltanbalazsmrg-effitascom

httpshulinkedincominzbalazs

Twitter ndash zh4ck

wwwslidesharenetbz98

Check out avataocom to practice issues like this

Hackersuli meetup

Greetz to CrySySLab SpamAndHex

JumpESPJumpblogspotcom

Page 5: Test & Tea : ITSEC testing, manual vs automated

This is still an issue which is not found by automated scanners by default

What do you do

This is still an issue which is not found by automated scanners by default

What do you do

adminadmin

Automated scanners donrsquot brute-force user logins by default

This is still an issue which is not found by automated scanners

What do you do

This is still an issue which is not found by automated scanners

What do you do

Automated scanners donrsquot have a clue that they should try this parameter they have never seen before

What is the problem here

Is this found by scanners

loginphpusername=adminamppassword[$ne]=asdfg

array(username =gt adminpassword =gt array(rdquo$ne =gt asdfg))

Usually scanners donrsquot know NoSQL And if they know they are usually not that smart

ProTIP instead of asdfg use a long complex password so you can be sure this is not the correct password )

Try this challenge here

httpsplatformavataocomchallenges28f5fca5-6a01-11e6-bdf4-0800200c9a66

Automated scanners continued

Informational issue (not high medium low severity)

ldquoAn unknown service is running on TCP port 4444rdquo

What do you do

Automated scanners continued

Sample requestcodephpsrc=codephpamphl[0]=niceamphl[1]=textampmode=hl

Solution

Bypass whitelist by change order of parameters

php0816codephphl[0]=niceamphl[1]=textampmode=hlampsrc=solutionphp

Try it here

httpwwwwechallnetchallengephp0816indexphp

Conclusion

Use a good tool for boring repetitive tasks

And use your brain for creative hacks

And always develop new tools for new problems

Hack the planet

zoltanbalazsmrg-effitascom

httpshulinkedincominzbalazs

Twitter ndash zh4ck

wwwslidesharenetbz98

Check out avataocom to practice issues like this

Hackersuli meetup

Greetz to CrySySLab SpamAndHex

JumpESPJumpblogspotcom

Page 6: Test & Tea : ITSEC testing, manual vs automated

This is still an issue which is not found by automated scanners by default

What do you do

adminadmin

Automated scanners donrsquot brute-force user logins by default

This is still an issue which is not found by automated scanners

What do you do

This is still an issue which is not found by automated scanners

What do you do

Automated scanners donrsquot have a clue that they should try this parameter they have never seen before

What is the problem here

Is this found by scanners

loginphpusername=adminamppassword[$ne]=asdfg

array(username =gt adminpassword =gt array(rdquo$ne =gt asdfg))

Usually scanners donrsquot know NoSQL And if they know they are usually not that smart

ProTIP instead of asdfg use a long complex password so you can be sure this is not the correct password )

Try this challenge here

httpsplatformavataocomchallenges28f5fca5-6a01-11e6-bdf4-0800200c9a66

Automated scanners continued

Informational issue (not high medium low severity)

ldquoAn unknown service is running on TCP port 4444rdquo

What do you do

Automated scanners continued

Sample requestcodephpsrc=codephpamphl[0]=niceamphl[1]=textampmode=hl

Solution

Bypass whitelist by change order of parameters

php0816codephphl[0]=niceamphl[1]=textampmode=hlampsrc=solutionphp

Try it here

httpwwwwechallnetchallengephp0816indexphp

Conclusion

Use a good tool for boring repetitive tasks

And use your brain for creative hacks

And always develop new tools for new problems

Hack the planet

zoltanbalazsmrg-effitascom

httpshulinkedincominzbalazs

Twitter ndash zh4ck

wwwslidesharenetbz98

Check out avataocom to practice issues like this

Hackersuli meetup

Greetz to CrySySLab SpamAndHex

JumpESPJumpblogspotcom

Page 7: Test & Tea : ITSEC testing, manual vs automated

This is still an issue which is not found by automated scanners

What do you do

This is still an issue which is not found by automated scanners

What do you do

Automated scanners donrsquot have a clue that they should try this parameter they have never seen before

What is the problem here

Is this found by scanners

loginphpusername=adminamppassword[$ne]=asdfg

array(username =gt adminpassword =gt array(rdquo$ne =gt asdfg))

Usually scanners donrsquot know NoSQL And if they know they are usually not that smart

ProTIP instead of asdfg use a long complex password so you can be sure this is not the correct password )

Try this challenge here

httpsplatformavataocomchallenges28f5fca5-6a01-11e6-bdf4-0800200c9a66

Automated scanners continued

Informational issue (not high medium low severity)

ldquoAn unknown service is running on TCP port 4444rdquo

What do you do

Automated scanners continued

Sample requestcodephpsrc=codephpamphl[0]=niceamphl[1]=textampmode=hl

Solution

Bypass whitelist by change order of parameters

php0816codephphl[0]=niceamphl[1]=textampmode=hlampsrc=solutionphp

Try it here

httpwwwwechallnetchallengephp0816indexphp

Conclusion

Use a good tool for boring repetitive tasks

And use your brain for creative hacks

And always develop new tools for new problems

Hack the planet

zoltanbalazsmrg-effitascom

httpshulinkedincominzbalazs

Twitter ndash zh4ck

wwwslidesharenetbz98

Check out avataocom to practice issues like this

Hackersuli meetup

Greetz to CrySySLab SpamAndHex

JumpESPJumpblogspotcom

Page 8: Test & Tea : ITSEC testing, manual vs automated

This is still an issue which is not found by automated scanners

What do you do

Automated scanners donrsquot have a clue that they should try this parameter they have never seen before

What is the problem here

Is this found by scanners

loginphpusername=adminamppassword[$ne]=asdfg

array(username =gt adminpassword =gt array(rdquo$ne =gt asdfg))

Usually scanners donrsquot know NoSQL And if they know they are usually not that smart

ProTIP instead of asdfg use a long complex password so you can be sure this is not the correct password )

Try this challenge here

httpsplatformavataocomchallenges28f5fca5-6a01-11e6-bdf4-0800200c9a66

Automated scanners continued

Informational issue (not high medium low severity)

ldquoAn unknown service is running on TCP port 4444rdquo

What do you do

Automated scanners continued

Sample requestcodephpsrc=codephpamphl[0]=niceamphl[1]=textampmode=hl

Solution

Bypass whitelist by change order of parameters

php0816codephphl[0]=niceamphl[1]=textampmode=hlampsrc=solutionphp

Try it here

httpwwwwechallnetchallengephp0816indexphp

Conclusion

Use a good tool for boring repetitive tasks

And use your brain for creative hacks

And always develop new tools for new problems

Hack the planet

zoltanbalazsmrg-effitascom

httpshulinkedincominzbalazs

Twitter ndash zh4ck

wwwslidesharenetbz98

Check out avataocom to practice issues like this

Hackersuli meetup

Greetz to CrySySLab SpamAndHex

JumpESPJumpblogspotcom

Page 9: Test & Tea : ITSEC testing, manual vs automated

What is the problem here

Is this found by scanners

loginphpusername=adminamppassword[$ne]=asdfg

array(username =gt adminpassword =gt array(rdquo$ne =gt asdfg))

Usually scanners donrsquot know NoSQL And if they know they are usually not that smart

ProTIP instead of asdfg use a long complex password so you can be sure this is not the correct password )

Try this challenge here

httpsplatformavataocomchallenges28f5fca5-6a01-11e6-bdf4-0800200c9a66

Automated scanners continued

Informational issue (not high medium low severity)

ldquoAn unknown service is running on TCP port 4444rdquo

What do you do

Automated scanners continued

Sample requestcodephpsrc=codephpamphl[0]=niceamphl[1]=textampmode=hl

Solution

Bypass whitelist by change order of parameters

php0816codephphl[0]=niceamphl[1]=textampmode=hlampsrc=solutionphp

Try it here

httpwwwwechallnetchallengephp0816indexphp

Conclusion

Use a good tool for boring repetitive tasks

And use your brain for creative hacks

And always develop new tools for new problems

Hack the planet

zoltanbalazsmrg-effitascom

httpshulinkedincominzbalazs

Twitter ndash zh4ck

wwwslidesharenetbz98

Check out avataocom to practice issues like this

Hackersuli meetup

Greetz to CrySySLab SpamAndHex

JumpESPJumpblogspotcom

Page 10: Test & Tea : ITSEC testing, manual vs automated

Is this found by scanners

loginphpusername=adminamppassword[$ne]=asdfg

array(username =gt adminpassword =gt array(rdquo$ne =gt asdfg))

Usually scanners donrsquot know NoSQL And if they know they are usually not that smart

ProTIP instead of asdfg use a long complex password so you can be sure this is not the correct password )

Try this challenge here

httpsplatformavataocomchallenges28f5fca5-6a01-11e6-bdf4-0800200c9a66

Automated scanners continued

Informational issue (not high medium low severity)

ldquoAn unknown service is running on TCP port 4444rdquo

What do you do

Automated scanners continued

Sample requestcodephpsrc=codephpamphl[0]=niceamphl[1]=textampmode=hl

Solution

Bypass whitelist by change order of parameters

php0816codephphl[0]=niceamphl[1]=textampmode=hlampsrc=solutionphp

Try it here

httpwwwwechallnetchallengephp0816indexphp

Conclusion

Use a good tool for boring repetitive tasks

And use your brain for creative hacks

And always develop new tools for new problems

Hack the planet

zoltanbalazsmrg-effitascom

httpshulinkedincominzbalazs

Twitter ndash zh4ck

wwwslidesharenetbz98

Check out avataocom to practice issues like this

Hackersuli meetup

Greetz to CrySySLab SpamAndHex

JumpESPJumpblogspotcom

Page 11: Test & Tea : ITSEC testing, manual vs automated

Automated scanners continued

Informational issue (not high medium low severity)

ldquoAn unknown service is running on TCP port 4444rdquo

What do you do

Automated scanners continued

Sample requestcodephpsrc=codephpamphl[0]=niceamphl[1]=textampmode=hl

Solution

Bypass whitelist by change order of parameters

php0816codephphl[0]=niceamphl[1]=textampmode=hlampsrc=solutionphp

Try it here

httpwwwwechallnetchallengephp0816indexphp

Conclusion

Use a good tool for boring repetitive tasks

And use your brain for creative hacks

And always develop new tools for new problems

Hack the planet

zoltanbalazsmrg-effitascom

httpshulinkedincominzbalazs

Twitter ndash zh4ck

wwwslidesharenetbz98

Check out avataocom to practice issues like this

Hackersuli meetup

Greetz to CrySySLab SpamAndHex

JumpESPJumpblogspotcom

Page 12: Test & Tea : ITSEC testing, manual vs automated

Automated scanners continued

Sample requestcodephpsrc=codephpamphl[0]=niceamphl[1]=textampmode=hl

Solution

Bypass whitelist by change order of parameters

php0816codephphl[0]=niceamphl[1]=textampmode=hlampsrc=solutionphp

Try it here

httpwwwwechallnetchallengephp0816indexphp

Conclusion

Use a good tool for boring repetitive tasks

And use your brain for creative hacks

And always develop new tools for new problems

Hack the planet

zoltanbalazsmrg-effitascom

httpshulinkedincominzbalazs

Twitter ndash zh4ck

wwwslidesharenetbz98

Check out avataocom to practice issues like this

Hackersuli meetup

Greetz to CrySySLab SpamAndHex

JumpESPJumpblogspotcom

Page 13: Test & Tea : ITSEC testing, manual vs automated

Sample requestcodephpsrc=codephpamphl[0]=niceamphl[1]=textampmode=hl

Solution

Bypass whitelist by change order of parameters

php0816codephphl[0]=niceamphl[1]=textampmode=hlampsrc=solutionphp

Try it here

httpwwwwechallnetchallengephp0816indexphp

Conclusion

Use a good tool for boring repetitive tasks

And use your brain for creative hacks

And always develop new tools for new problems

Hack the planet

zoltanbalazsmrg-effitascom

httpshulinkedincominzbalazs

Twitter ndash zh4ck

wwwslidesharenetbz98

Check out avataocom to practice issues like this

Hackersuli meetup

Greetz to CrySySLab SpamAndHex

JumpESPJumpblogspotcom

Page 14: Test & Tea : ITSEC testing, manual vs automated

Solution

Bypass whitelist by change order of parameters

php0816codephphl[0]=niceamphl[1]=textampmode=hlampsrc=solutionphp

Try it here

httpwwwwechallnetchallengephp0816indexphp

Conclusion

Use a good tool for boring repetitive tasks

And use your brain for creative hacks

And always develop new tools for new problems

Hack the planet

zoltanbalazsmrg-effitascom

httpshulinkedincominzbalazs

Twitter ndash zh4ck

wwwslidesharenetbz98

Check out avataocom to practice issues like this

Hackersuli meetup

Greetz to CrySySLab SpamAndHex

JumpESPJumpblogspotcom

Page 15: Test & Tea : ITSEC testing, manual vs automated

Conclusion

Use a good tool for boring repetitive tasks

And use your brain for creative hacks

And always develop new tools for new problems

Hack the planet

zoltanbalazsmrg-effitascom

httpshulinkedincominzbalazs

Twitter ndash zh4ck

wwwslidesharenetbz98

Check out avataocom to practice issues like this

Hackersuli meetup

Greetz to CrySySLab SpamAndHex

JumpESPJumpblogspotcom

Page 16: Test & Tea : ITSEC testing, manual vs automated

Hack the planet

zoltanbalazsmrg-effitascom

httpshulinkedincominzbalazs

Twitter ndash zh4ck

wwwslidesharenetbz98

Check out avataocom to practice issues like this

Hackersuli meetup

Greetz to CrySySLab SpamAndHex

JumpESPJumpblogspotcom