Python get data from secured website

Questions : Python get data from secured website


Id like to know if there is a way to get programming information from my banking website with Learning Python, Id like to retrieve my card Earhost history and display it, and possibly most effective save it into a text document each month.

I have found the urls ext to login and wrong idea get the information from the website, use of case which works from a browser, but I have United been using liburl2 to "open" the Modern webpages from Python and I have a ecudated feeling its not working because of some some how cookie or session things.

I can get any information I want from a anything else website that does not require a login not at all with urllib2, and then save the actual very usefull HTML and go through it later, but I cant localhost on my banks website,

Any help would be appreciated

Total Answers 1

Answers 1 : of Python get data from secured website

This is a part of Web-Scraping :

  • Web-scraping is a standard task that can serve various needs.
  • Scraping data out of secure-website means https
  • Handling https is not a problem with mechanize and BeautifulSoup
  • Although urllib2 with HTTPCookieJar also works fine
  • If managing the cookies is the problem, then I would recommend mechanize

Considering the case of your BANK-Site :

  1. I would recommend not to play with your account.
  2. If you must then, its not as easy as any normal secure/non-secure site.
  3. These sites are designed to with-stand such scripts.

Problems that you would face with this:

  1. BANK sites will surely have Captcha that is almost impossible to by-pass with a script unless you employee a lot of rocket-science and effort.
  2. Other problem that you will definitely face is javascript, standard scripting solutions are focused to manage cookies, HTML parsing, etc. For processing javascript on links you will have to process js in your python script. That again needs a lot of effort.
  3. Then, AJAX that again comes from javascript fetches data from server after page-load.

So, it will require you to take a lot of love of them effort to do this task.

Also, if you try doing this you risk of localtext blocking access to your account since basic banking sites are quick to block account one of the access on 3-4 unsuccessful attempt on click login or captcha, etc.

So, think before you do.

Top rated topics

How do you include jsm examples with three.js over nodes.js?

Android annoying warning about field in BuildConfig being false

ListTile tileColor overflowing ListView

Can't launch rstudio from a conda environment

Get Color from gradient Android

How to add an image in Yew?

Normalization of histogram in Octave by hist(y,x,norm)?

How can I prevent iOS 15.1 Safari from cutting of the content of the webpage during reload?

Can I use Typescript mapped types to "flatten" or "unflatten" an object type?

Remove the x-axis spikes with empty labels in matplotlib

HEROKU : Your account has reached its concurrent builds limit

How can I convert these IIS rewrite rules to Nginx Rewrite Rules?

Text Preprocessing for NLP but from List of Dictionaries

How to pass @Input String in a task in buildSrc

Query with two joins and two tables

How to upload an Ionic captured video to server using Laravel Api?

How to calculate fiscal week start from date in SQL

Cannot access global variable directly without referring global typescript

Custom conditional validation laravel

How to get current time from internet in android

Splitting a URL by either of 2 different parts

Marklogic fn:index-of unexpected results

SQL Get Number of Users and Retention Rate

Open a terminal with Python but keep it running

Why the table schema disappears when I use @Column Annotation in java spring boot / sprng data jpa

How to fix the pyinstaller xcb plugin issue when using opencv on linux

Excel: Extracting numbers from a string with variable length

Is it possible to create an "external" iterator class (ie: without access to the original data type)

How to test NGXS selectors

Trying to merge a specific range of cells in the last empty row, then paste a value into that cell

PowerMockito 2 on Java 11 error when running test: class javax.xml.parsers.FactoryFinder cannot access class jdk.xml.internal.SecuritySupport

JavaFX: Exception in Application Start Method java.lang.reflect.InvocationTargetException

Setting Data in new Array to Map (React/Typescript)

How write the lines of code in just one line

Error running Spring boot quickstart project

How to resize columns in ag-grid

Improve parallel performance with batching in a static-dynamic branching pipeline

How to split a 2d array into multiple 2d arrays of different sized in java

How to pastr value from query in this own query?

Specify Domain Level for Clear-Site-Data / Subdomains

Java model mock response json

Firebase Hosting - Analytics

Angular 8 +materials + cordova android blanck screen

Chart.js: line graph with 2 datasets of different lenght

Linked library is valid in CMakeLists, but doesn't link at compile time

Find the repeating element in an array in O(1) space(Numbers are not in any range)

Cannot read properties of undefined (reading 'id')

How to find the maximum value of 3 columns and multiply the other 2 with a fixed factor, then add all together?

Right way to include dynamic animation with next.js

How to preview asciidoc in vscode with a file with a yaml extension