Comments on: Get Data from Website that Requires a Login

By: Dick Kusleika

Dick Kusleika — Wed, 27 Mar 2013 22:50:13 +0000

Nope. Anything that processes server-side isn’t going to be much help when you’re parsing html. Sorry.

By: John

John — Wed, 27 Mar 2013 09:45:47 +0000

Hi Will it be possible to adapt this code for a ComponentArt_Grid? The source code of the HMTL that I want to extract the data from has the following code: window.SharesAndIndices1_smartGrid1 = new ComponentArt_Grid('SharesAndIndices1_smartGrid1'); SharesAndIndices1_smartGrid1.Data = [[[new Date(2013,2,26,0,0,0),'26 Mar 2013'],16062,15600,15778,16000,1490791,[0.00,'0.00'],[0.00,'0.00'],[3.64,'3.64'],[7.67,'7.67'],[13.04,'13.04'],[3.64,'3.64']],[[new Date(2013,2,25,0,0,0),'25 Mar 2013'],15713,15250,15400,15600,2273264,[0.00,'0.00'],[0.00,'0.00'],[3.73,'3.73'],[7.87,'7.87'],[12.71,'12.71'],[3.73,'3.73']], Which then continues for all the entries. How will one import this into Excel? Thanks!

By: Web Query for a password protected website

Web Query for a password protected website — Thu, 22 Nov 2012 15:27:19 +0000

[...] [...]

By: Get Data from Website that Requires a Login « Excel Notes from Anthonli

Get Data from Website that Requires a Login « Excel Notes from Anthonli — Fri, 02 Nov 2012 13:55:08 +0000

[...] Get Data from Website that Requires a Login. Like this:LikeBe the first to like [...]

By: Ronni Andersen

Ronni Andersen — Mon, 17 Sep 2012 06:30:09 +0000

Hey Dick.

First of all thanks for all the answers.
I want data from a website with pass and login. I use your way, but i did not get data in excel.
The login works fine, but there is no table id of the table i want, so what to do. Is there a way to get the whole page?

Here is my code:

Sub GetTable()

Dim ieApp As InternetExplorer
Dim ieDoc As Object
Dim ieTable As Object
Dim clip As DataObject

'create a new instance of ie
Set ieApp = New InternetExplorer

'you don’t need this, but it’s good for debugging
ieApp.Visible = True

'assume we’re not logged in and just go directly to the login page
ieApp.navigate "http://www.installationsblanket.dk/Logon.asp"
Do While ieApp.Busy: DoEvents: Loop
Do Until ieApp.readyState = READYSTATE_COMPLETE: DoEvents: Loop

Set ieDoc = ieApp.document

'fill in the login form – View Source from your browser to get the control names
With ieDoc.forms(0)
.Brugernavn.Value = "roan"
.Adgangskode.Value = "roan"
.submit
End With
Do While ieApp.Busy: DoEvents: Loop
Do Until ieApp.readyState = READYSTATE_COMPLETE: DoEvents: Loop

'now that we’re in, go to the page we want
ieApp.navigate "http://www.installationsblanket.dk/selskab/600.asp"
Do While ieApp.Busy: DoEvents: Loop
Do Until ieApp.readyState = READYSTATE_COMPLETE: DoEvents: Loop

'get the table based on the table’s id
Set ieDoc = ieApp.document
Set ieTable = ieDoc.all.Item("")

'copy the tables html to the clipboard and paste to teh sheet
If Not ieTable Is Nothing Then
Set clip = New DataObject
clip.SetText "" & MieTable.innerHTML & ""
clip.PutInClipboard
Sheet1.Select
Sheet1.Range("A1").Select
Sheet1.PasteSpecial "Unicode Text"
End If

'close 'er up
ieApp.Quit
Set ieApp = Nothing

End Sub

Im pretty new in VBA, what can i write at last to get the table?

Thanks for help.

By: Ronni

Ronni — Sun, 16 Sep 2012 08:22:56 +0000

Hello Dick.

I Use your code, but i dont get data. The login works fine. I cant see a table id, but it would all so be fine with the whole site? Can yoy helt me?

Here is my code:

Sub GetTable()

Dim ieApp As InternetExplorer
Dim ieDoc As Object
Dim ieTable As Object
Dim clip As DataObject

'create a new instance of ie
Set ieApp = New InternetExplorer

'you don’t need this, but it’s good for debugging
ieApp.Visible = True

'assume we’re not logged in and just go directly to the login page
ieApp.navigate "http://www.installationsblanket.dk/Logon.asp"
Do While ieApp.Busy: DoEvents: Loop
Do Until ieApp.readyState = READYSTATE_COMPLETE: DoEvents: Loop

Set ieDoc = ieApp.document

'fill in the login form – View Source from your browser to get the control names
With ieDoc.forms(0)
.Brugernavn.Value = "***"
.Adgangskode.Value = "***"
.submit
End With
Do While ieApp.Busy: DoEvents: Loop
Do Until ieApp.readyState = READYSTATE_COMPLETE: DoEvents: Loop

'now that we’re in, go to the page we want
ieApp.navigate "http://www.installationsblanket.dk/selskab/600.asp"
Do While ieApp.Busy: DoEvents: Loop
Do Until ieApp.readyState = READYSTATE_COMPLETE: DoEvents: Loop

'get the table based on the table’s id
Set ieDoc = ieApp.document
Set ieTable = ieDoc.all.Item("")

'copy the tables html to the clipboard and paste to teh sheet
If Not ieTable Is Nothing Then
Set clip = New DataObject
clip.SetText "" & ieTable.outerHTML & ""
clip.PutInClipboard
Sheet1.Select
Sheet1.Range("A1").Select
Sheet1.PasteSpecial "Unicode Text"
End If

'close 'er up
ieApp.Quit
Set ieApp = Nothing

End Sub

By: sam

sam — Thu, 28 Jun 2012 23:46:09 +0000

hi, i read all comments about getting the explorer to login to a webpage where username and password is needed, i am trying to get my code to do that for me, but iwas unsuccesful, probably i dont get the right input name, let me give here the source page maybe some1 can tell me exactly what to put in the VBA,

By: Dick Kusleika

Dick Kusleika — Tue, 19 Jun 2012 16:05:37 +0000

Ankit: Well, it looks like that web app was deleted. In other bad news, I can’t seem to find the source code – possibly also deleted. I probably looked at it and couldn’t figure out why I wrote it. I’ll try to recreate it and get it back up.

By: Ankit

Ankit — Fri, 15 Jun 2012 18:06:34 +0000

Dick: I have tried using your code and it is working fine till the code line mentioned below:

Set ieDoc = ieApp.Document

At the above line code stops and gives an error

Run-time error ‘-2147467259 (80004005)”
Automation Error
Unspecified Error

Any idea as to why am I getting this error?

Thanks in advance.

By: Dick Kusleika

Dick Kusleika — Tue, 15 May 2012 13:44:46 +0000

Matthew: The login controls don’t appear to be part of a form tag or there’s some javascript business that creates the POST action. I don’t think this method will work. You can try JPs method up in the second comment. I couldn’t get it to work, but it might be worth trying with a real username and password.