Visual Builder

Get Involved. Join the Conversation.

Topic

    Ziv Rubin
    Browser Crashed While Trying to Load 20K Rows From External...
    Topic posted August 4, 2019 by Ziv RubinBronze Medal: 1,250+ Points, tagged Business Objects, Database, Groovy, REST, Web 
    21 Views, 11 Comments
    Title:
    Browser Crashed While Trying to Load 20K Rows From External REST API
    Content:

    Hi All,

    While trying to load data from a rest API to a Business Object, it suddenly crashes - probably because I was trying to load 20K rows.

    Does anyone know a better way to load data from external REST API to my VBCS BO?

    Thanks,

    Ziv

    Comment

     

    • John Ceccarelli

      What exactly are you trying to do? Do you have a Groovy trigger that calls a REST API to fetch 20K records and then insert them into the BO?

      • Ziv Rubin

        Hi John,

        I do not have a Groovy trigger that calls a REST API, I'm using ForEach Action from a Flow (20K BO REST API Calls).

        Thank you,

        Ziv

    • John Ceccarelli

      So you're trying to call REST 20K times? This is a bad idea :-) So what exactly are you trying to achieve? You have a BO and there is a REST resource somewhere and you want to load the data from the REST resource into the BO?

    • Ziv Rubin

      Yes, Exactly :-)

      I know it is a bad idea, which worked for 1K calls.

       

      Thanks!

    • John Ceccarelli

      Does this need to happen all the time or is this just part of regular data sync? 

      • Ziv Rubin

        Hi John,

        This is just a regular weekly data sync process (I hope to find a constant solution for this).

        Thanks!

    • John Ceccarelli

      Do you have a way to dump the data you're trying to upload to CSV? If so you could use the bulk data loading APIs.

      • Ziv Rubin

        Not going to work business-wise...

        Whats bulk data loading API? Do you mean using the Batch call from VBCS?

        Thanks,

        Ziv

    • Shay Shmeltzer

      Is there a reason to do this from the UI?

      This seems like a fit for a batch operation that doesn't involve the browser UI.

      Use some batch engine to send the REST requests instead.

      • Ziv Rubin
        Hi Shay, Hope you doing well. How can I load data from external API without the browser? (or whats batch engines are?) Thank you! Ziv
        • Shay Shmeltzer

          The REST APIs that are exposed on Business Objects are accessible from outside VB.

          So you can call them from any piece of software - for example from shell scripts that execute curl commands.

          You can write a little program with your favorite language that calls the REST APIs to insert the data and invoke it for example from a build job that you run on Oracle Developer Cloud every night.