Showing posts with label 파이썬. Show all posts
Showing posts with label 파이썬. Show all posts

Saturday, October 17, 2015

What is Data Parsing?



While I was struggling to build my python code for automatic login system, I had seen the word 'data parsing' many times.
What the hell is 'data parsing' and why we need to parse data?


  • Definition
  •  Breaking data into smaller parts so that it can be more easily interpreted.

  • My understanding
  •  Reorganizing given data to more structured form so that we can use data more easily. 

Aha! Parsing data helps me to understand data structure and use them more easily! 
The next step is parsing HTML with Python



*Images will be added soon to help understanding.






Automatic Website Login using Python2


  • IDEA
    1. Open Url
    2. Log in with credentials
    3. go to page I want 
    4. download files I need

  • Tools
    1. Python2.7
    2. selenium, beautiful soup module VS pyautogui module

  • Note
    • silent crawling with Phantom JS
    • Need more study about HTML
    • How can I maintain session
    • what is parsing?


I have used selenium module to control website. 
Opening website automatically is kind of easy. All you need is below code: