locked
Data Management Gateway Limit RRS feed

  • Question

  • I've managed to get the on premises Data Management Gateway working. However, I quickly bumped into a limitation that seems to be hard.

    Querying a single table with just over a million rows (election data) Power Query returns an error:

    [DataSource.Error]   Cannot parse OData response result.    Error: The maximum number of bytes allowed to be read from the stream   has been exceeded. After the last read operation, a total of 104858624 bytes   has been read from the stream; however a maximum of 104857600 bytes is   allowed.

    Is the maximum size of a query rendered by the data management gateway truly 100 MB? Is this for preview, for GA, or am I just missing a configuration step?

    Cheers


    John

    Friday, September 6, 2013 5:34 PM
    Moderator

Answers

  • Hi John,

    As a follow up, we do have a limit today, we're following up with Gateway and Power Query team, will reply back when there is further information.

    Samuel

    Wednesday, September 11, 2013 2:07 PM
    Moderator

All replies

  • John,

    We have been looking into this issue, and will be able to provide an update once we completed the investigations.
    For the table that you have selected, can you share the data types and number of columns for the table?

    Thanks,
    wee-hyong

    Monday, September 9, 2013 6:00 AM
  • Hi Wee-hyong

    Absolutely.

    This dataset is a simple flat view, with 20 columns. The columns are int, bit, nchar(10), nvarchar(250), and nvarchar(MAX). There are 1,051,443 rows in the source.

    I can share the database with you if that helps.


    John

    Monday, September 9, 2013 2:12 PM
    Moderator
  • Thanks John. Could you send to raguan@microsoft.com?
    Monday, September 9, 2013 2:51 PM
  • Thanks Ray. DB link sent.

    Cheers


    John

    Monday, September 9, 2013 3:20 PM
    Moderator
  • Hi John,

    As a follow up, we do have a limit today, we're following up with Gateway and Power Query team, will reply back when there is further information.

    Samuel

    Wednesday, September 11, 2013 2:07 PM
    Moderator
  • It appears that the limit is gone with the Nov 2013 version of the gateway.

    John

    Monday, November 18, 2013 12:47 AM
    Moderator