none
How to select table columns from a web source RRS feed

  • Question

  • Hello,

    take a look at this ETF screener, please:

    https://www.justetf.com/it/find-etf.html

    In Chrome, the user can select rows and columns (and other); is it possible to do the same in power bi when importing a table?

    Thanks in advance,

    Franco

    Saturday, December 21, 2019 6:31 PM

Answers

  • Hi Franco. PQ can only tweak the parameters of a page if they can be specified as part of the URL, or via other parts of a web request. PQ is not able to simulate UI actions which don't have a corresponding representation in the URL/request.

    Ehren

    Monday, January 13, 2020 8:49 PM
    Owner

All replies

  • Hi Franco ,

    you can scrape everything that is reachable through a distinct URL. So you make some selections on that page you might end up with a URL like this: https://www.justetf.com/it/find-etf.html?groupField=none&sortField=fundSize&sortOrder=desc&tab=rollreturn&rpe=rpeEom 

    Every parameter you see here can be replaced by a variable.

    But the big problem I see with that site is that it just returns the figures from the first page. So that's probably not what you want, right?


    Imke Feldmann - MVP Data Platform (PowerBI) - http://www.TheBIccountant.com 

    Please use the 'Mark as answer' link to mark a post that answers your question. If you find a reply helpful, please remember to vote it as helpful - Thanks!

    Sunday, December 22, 2019 7:48 AM
    Moderator
  • Hi Imke,

    I am aware that it is possible to replace each parameter of the URL with a variable, but unfortunately the parameters I am interested in are not part of it or I do not know their codes. As you have already seen, the selection of the number of rows and especially the columns to be displayed must be made on the page itself, only after it has been downloaded. Does this mean that all data have already been locally stored? But how do you catch them?

    Thanks, Franco

    Sunday, December 22, 2019 9:06 AM
  • Hi Franco. PQ can only tweak the parameters of a page if they can be specified as part of the URL, or via other parts of a web request. PQ is not able to simulate UI actions which don't have a corresponding representation in the URL/request.

    Ehren

    Monday, January 13, 2020 8:49 PM
    Owner
  • Hi Ehren,
    thanks for the clarification, can i ask you one more question? On that same web page I can choose the columns to be displayed without, at least apparently, the page needs to be reloaded. Wouldn't it be possible to do the same with PQ?
    Thanks in advance,
    Franco
    Tuesday, January 14, 2020 12:25 PM