Unconfigured Ad Widget

Collapse

Language to interact with websites

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • JDoe
    CGN/CGSSA Contributor - Lifetime
    CGN Contributor - Lifetime
    • Jul 2008
    • 2430

    Language to interact with websites

    What programming languages are useful/better for interacting with websites. I want to be able to send input and then get output for a specific project.
    sigpic
  • #2
    Fizz
    Senior Member
    • Feb 2012
    • 1473

    You need to clarify what you're trying to accomplish.

    Python can be readily used for web scraping. Here's a guide that describes this from elementary principles onward. https://realpython.com/beautiful-sou...s-web-scraping

    If you're trying to say, fill out a form on a website automatically, and get some content/value from the page, programming LANGUAGES might not be the best solution.

    For example, you can use iMacros to take a database of values, type them into web forms automatically, and retrieve information/content from the resulting pages. Imacros can do all sorts of web scraping as well. It can be commanded with JavaScript language, but this isn't a strict requirement. This is one of the few viable methods if the page you're interacting with has a captcha (I'm not a robot - type images) - since you can pause and have an human validate the captcha but let all other processes be automatic.



    Example. You want to take a database (CSV) of first name, last name, DOB, address and automatically register the list of people for an event with an online form, and retrieve a confirmation ID/Receipt number from the page associated with each person. This could be done with imacros, Python or Javascript.

    I like Python as a general purpose '**** around' do anything language because of the ease of syntax, huge community of support if you need it, and loads of built in modules. But for two way information with websites, imacros is the better solution IMO.

    Comment

    • #3
      JDoe
      CGN/CGSSA Contributor - Lifetime
      CGN Contributor - Lifetime
      • Jul 2008
      • 2430

      Originally posted by Fizz
      You need to clarify what you're trying to accomplish.

      Python can be readily used for web scraping. Here's a guide that describes this from elementary principles onward. https://realpython.com/beautiful-sou...s-web-scraping

      If you're trying to say, fill out a form on a website automatically, and get some content/value from the page, programming LANGUAGES might not be the best solution.

      For example, you can use iMacros to take a database of values, type them into web forms automatically, and retrieve information/content from the resulting pages. Imacros can do all sorts of web scraping as well. It can be commanded with JavaScript language, but this isn't a strict requirement. This is one of the few viable methods if the page you're interacting with has a captcha (I'm not a robot - type images) - since you can pause and have an human validate the captcha but let all other processes be automatic.



      Example. You want to take a database (CSV) of first name, last name, DOB, address and automatically register the list of people for an event with an online form, and retrieve a confirmation ID/Receipt number from the page associated with each person. This could be done with imacros, Python or Javascript.

      I like Python as a general purpose '**** around' do anything language because of the ease of syntax, huge community of support if you need it, and loads of built in modules. But for two way information with websites, imacros is the better solution IMO.

      Thank you Fizz! That is the kind of info/help I was looking for and is what I wanted to do.
      sigpic

      Comment

      Working...
      UA-8071174-1