Posts

Posts

  • Marty Gubar
    Big Data SQL 4.0 is now Available5.0
    Topic posted July 11, 2019 by Marty GubarRed Ribbon: 250+ Points, tagged Analytics, Big Data Appliance, Big Data SQL, Data Management, Hadoop in Data Management > Big Data public
    Title:
    Big Data SQL 4.0 is now Available
    Summary:
    The latest release of Big Data SQL is available for download
    Content:

    I’m excited to announce the availability of Big Data SQL 4.0.  This release is packed with new capabilities:

    Big Data SQL 4.0 can be downloaded from http://edelivery.oracle.com.  It requires Oracle Database 18c (18.6) plus a one off patch (patch # 29379046) that you can download from My Oracle Support.  If you are still on Oracle Database 12.1 or 12.2 – you should continue to use Big Data SQL 3.2.x.

  • Marty Gubar
    Big Data SQL 3.2.1.2 for Oracle Database 12.2 Jan Release...
    Topic posted March 15, 2019 by Marty GubarRed Ribbon: 250+ Points, tagged Big Data Appliance, Big Data SQL, Data Management, Hadoop in Data Management > Big Data public
    Title:
    Big Data SQL 3.2.1.2 for Oracle Database 12.2 Jan Release Update
    Summary:
    BDSQL Patch now available for Oracle Database JAN Release Update
    Content:

    Wanted to give a quick update.

    Big Data SQL 3.2.1.2 and its associated one-off patch for Oracle Database 12.2 January RU are now available for download:

    • Patch 26170659 for DATABASE JAN 2019 RELEASE UPDATE 12.2.0.1.190115.  The one off patch must be applied to both Grid Infrastructure and Database Homes (see patch readme for details).
    • Big Data SQL 3.2.1.2 released on ARU as Patch 29489551: BDSQL 3.2.1.2 INSTALLER BUNDLE.  It will also be made available on edelivery shortly.  This installation must be applied to the Hadoop cluster as it contains updates to the Big Data SQL cells.

    Thanks!

    Marty

  • candan pehlivanoglu
    How should we gather external table stats on bda via bigdata...1
    Topic posted January 2, 2019 by candan pehlivanogluGreen Ribbon: 100+ Points, tagged Analytics, Big Data Appliance, Big Data SQL, Data Management, Hadoop in Data Management > Big Data public
    Title:
    How should we gather external table stats on bda via bigdata sql.
    Summary:
    Gather stats for external tables.
    Content:

    Hello all;

    We use bds for our external tables. We have daily jobs  to ingest these tables on big data and nealry 200 tables. These tables are partitioned on hive. But, on oracle site, since there isn't any partition column, we should gather all statistic every day. It is taking too much time. Do you have any other method for this operation. Since we use these tables on oracle, Oracle should be able to know statistic information.

     

    thank you.

     

  • Jean-Pierre Dijcks
    Release Update and Roadmap for BDA 4.x (CDH 5.x) and...35.0
    Topic posted December 14, 2018 by Jean-Pierre DijcksSilver Medal: 2,000+ Points, tagged Big Data Appliance, Hadoop, Spark, Tip in Data Management > Big Data public
    Title:
    Release Update and Roadmap for BDA 4.x (CDH 5.x) and 5.x (CDH 6.x)
    Summary:
    A short review and update of the upcoming release dates for BDA releases
    Content:

    As we race towards the end of 2018, based on questions from the community, here is the latest information on releases to expect for the BDA platform:

    BDA 5.0 - CDH 6.0.2: While we tried hard to squeeze it into the calendar year, we now expect this to release second half of January 2019

    BDA 4.14 - CDH 5.15.x: We expect that to happen, with a bunch of additional upgrade, migration etc testing early March. There is a small chance this can slip into February, but for upgrade planning to the last CDH 5.x, I would go with March 2019

    Lastly, one of the key things some of our customers are looking at, the in-place update of Oracle Linux 6.x to Oracle Linux 7.x. This one we anticipate to be an updated base image that provides the capabilities, and are on track for a mid-January 2019 delivery to customers.

    As you all know, we really try to get releases out as quickly as we can, but specifically going to C6, we do want to spend the time to get the (or most) upgrade issues sorted out before releasing. Thanks for your patience.

    Thanks all for a great 2018, hope that we can make your upgrades robust and successful in 2019.

    JP

    Version:
    CDH 5.x, CDH 6.x
  • Marty Gubar
    Big Data SQL 3.2 - Cloudera Certified5.0
    Topic posted October 29, 2018 by Marty GubarRed Ribbon: 250+ Points, tagged Analytics, Big Data Appliance, Big Data SQL, Data Management, Hadoop, SQL, Tip in Data Management > Big Data public
    Title:
    Big Data SQL 3.2 - Cloudera Certified
    Summary:
    Big Data SQL 3.2.1 is now officially certified with Cloudera 5.14.1
    Content:

    Big Data SQL 3.2.1 is now officially Cloudera Certified (see Oracle certified products here).  The certification took place with Cloudera 5.14.1.  The testing captures real world functional integration usage of the product on a cluster that meets certain security requirements, including:

    • Kerberos
    • Sentry
    • HDFS Encryption
    • Auditing
    • Network Encryption. 

    It also examines the product architecture, including integration with Cloudera Manager and key CDH Components.  Finally, it reviews how the product leverages scale-out processing on Hadoop clusters.

  • Jean-Pierre Dijcks
    BDA 4.14 - Current plan and timelines to uptake CDH 5.1645.0
    Topic posted October 12, 2018 by Jean-Pierre DijcksSilver Medal: 2,000+ Points, tagged Big Data Appliance, Hadoop in Data Management > Big Data public
    Title:
    BDA 4.14 - Current plan and timelines to uptake CDH 5.16
    Summary:
    Roadmap to the last CDH 5.x release on BDA and BDCS/BDCC
    Content:

    A quick update to the community on the current estimated timelines around CDH 5.16 on BDA (and the other platforms).

    While we are working on up taking, and enabling an easy migration to C6.0.1, we are also working on getting the last 5.x release to everyone. The current timelines for BDA 4.14 are around the early - mid December timeframe. That is going to be based on the then-current 5.16 version, most likely something like 5.16.1.

    Note that this is Cloudera's last "major" C5 release (e.g. 5.X). Various maintenance releases (e.g. 5.x.Y) will be arriving and those are of course supported per our standard policies.

    For those moving to the latest 5.x releases do keep the migration to C6 in mind. Review this link for this from the Cloudera side of things: https://www.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_install_upgrade_notes.html#concept_gzr_xgv_pdb. Keep an eye of these notes and the release notes for 6.0.1 once it arrives, as this does impact your strategy to move between releases.

    Version:
    BDA 4.14, CDH 5.16, CDH 6.0
  • Jean-Pierre Dijcks
    Now Available: BDA 4.13.0 is now available for download5.0
    Topic posted September 21, 2018 by Jean-Pierre DijcksSilver Medal: 2,000+ Points, tagged Big Data Appliance, Hadoop, Spark, Zeppelin in Data Management > Big Data public
    Title:
    Now Available: BDA 4.13.0 is now available for download
    Summary:
    Availability of the latest Mammoth bundle
    Content:

    Hi all,

    You can now find the latest Mammoth bundles for BDA 4.13 on our My Oracle Support site. Bundles for OL7 (new clusters only) and OL6 (upgrades for OL6 based systems) are available. This release is based on Cloudera Enterprise 5.15 (CDH 5.15.1 & Cloudera Manager 5.15.1) as well as Oracle NoSQL Database 18.1.11.

    Oracle Big Data Appliance 4.13.0 includes the following new features:

    • Oracle Big Data Manager now Supports Active Directory Kerberos and External MIT Kerberos Key Distribution Centers - Oracle Big Data Manager is a browser-based tool that gives you broad capabilities to manage data across your enterprise. You can use it to connect to and interconnect a range of supported Oracle and non-Oracle data storage providers, including Oracle Object Store, Hadoop, S3, and GitHub. You can also move data internally within HDFS, do data import/export/backup and analytics with Apache Zeppelin, and import data into Hive tables. It has been included since BDA Mammoth v4.12.0 .
    • Active Directory Kerberos Configuration on Oracle BDA no Longer Requires an SSL Certificate - In this release of Oracle Big Data Appliance, both the Mammoth installer and the bdacli enable ad_kerberos command enable AD Kerberos without the need for an SSL certificate. AD Kerberos can be enabled whether /opt/oracle/BDAMammoth/active_directory.cer is present or not . Customers have the option to add an AD Kerberos SSL certificate. Both SHA-1 and SHA-2 are supported.
    • SHA-2 Supported for Security Certificates Used with SSL - Oracle Big Data Appliance now supports SHA-2 (specifically, the SHA256, SHA384 and SHA512 Cryptographic Hash Algorithms) for signing SSL certificates.
    • Kafka Clusters are now Extensible - Kafka clusters are now extensible. This feature was not available in Oracle Big Data Appliance 4.12. The ."mammoth -e" command is used to extend both CDH and Kafka clusters.
    • New Disk Configuration Utility - There is a new bdaconfiguredisk disk configuration utility. Currently it can be used to display a summary of disk states, clear an unexpected disk state and reprovision a replaced data disk.
    • Disk Shredding for Secure Node Decommissioning - The bdasecureerasenode utility securely erases all data partitions on the node where it is executed. This utility is based on shred command from the GNU Core Utilities.

    The latest documentation for this release is here.

    Let us know if there are any questions.

    JP

    Version:
    BDA 4.13, CDH 5.15.1
  • Jean-Pierre Dijcks
    Start planning your C5 -> C6 updates14.0
    Topic posted September 6, 2018 by Jean-Pierre DijcksSilver Medal: 2,000+ Points, tagged Big Data Appliance, Data Management, Hadoop, Spark in Data Management > Big Data public
    Title:
    Start planning your C5 -> C6 updates
    Summary:
    A short roadmap update on CDH 6.0.1 on Oracle Big Data
    Content:

    As most of you will have seen, Cloudera recently released Cloudera 6. The following blog post describes our planned uptake of C6, and what to expect from that step.

    Start planning your C6 upgrades.

    As always, comments and questions welcome, and we hope this information is useful for all in understanding upgrades, and possibilities as well as timing.

    Version:
    CDH 6.0.1
  • Jean-Pierre Dijcks
    Using UI Based Upgrade for BDCS Cloudera Upgrades4.0
    Topic posted September 5, 2018 by Jean-Pierre DijcksSilver Medal: 2,000+ Points, tagged Big Data Appliance, Data Management, Hadoop, Spark, Tip in Data Management > Big Data public
    Title:
    Using UI Based Upgrade for BDCS Cloudera Upgrades
    Summary:
    Upgrading BDCS to a new CDH version, what you need to know
    Content:

    A few quarters ago BDCS got the much anticipated UI based - one-click upgrade. This enables any customer to easily see what newer CDH versions are available on their cluster and then choose which one to go to. Click a button et voila.

    Now, there is a small issue when the underlying infrastructure of the cluster is a little bit older. And when you run your pre-checks, you will see the information shown in below's image. This indicates that a pre-check has detected that specific issue on your BDCS instance and you will need to apply a small patch to the system. This is pretty pain free, but does have to happen before you can apply the upgrades.

    The exact message is: Failure: [[u'This cluster needs a patch in order to proceed with upgrade. Please contact support to download and install the patch.']]

    If you run into this issue, please do log a quick SR with Oracle Support and you may want to mention the related bug number: 28460510 to ensure the shortest turnaround time. When you file this SR make sure to include the base version information. To get that run:

    rpm -q bda

    The output will be something like: 

    bda-4.11.4-1.el6.x86_64

    Once included, our support team will be able to quickly point you at the patch.

    Version:
    18.2.3, 18.2.5
    Image:
    Code Snippet:
  • Jean-Pierre Dijcks
    Cloudera 6 released - when will we have it on BDCS/BDCC &...4.5
    Topic posted August 31, 2018 by Jean-Pierre DijcksSilver Medal: 2,000+ Points, tagged Big Data Appliance, Data Management, Hadoop, Spark, SQL in Data Management > Big Data public
    Title:
    Cloudera 6 released - when will we have it on BDCS/BDCC & BDA
    Summary:
    Quick update on Cloudera 6 on BDCS and BDA as well as BDCC
    Content:

    With the release of C6 on August 30th, we are now working towards releasing this on the Oracle Big Data stack (cloud and on-premises).

    We did want to ensure that we communicate some of the important functionality bits and when what would arrive, purely based on the Cloudera schedule:

    (1) The current 6.0 version does not really support Erasure Coding yet. This is because, while the HDFS service supports it, the query engines are not yet running on Erasure Coding. Consequently, you will only be able to do some testing with Erasure coding in terms of cold storage or experimenting with the sizes and reduction in sizes you could achieve. Erasure coding will arrive fully in C6.1.

    (2) Almost all major components in C6 will do a major version uptick. So, rather then wait for C6.1, Oracle will uptake 6.0.1 on BDA, which will enable our customers to move to these newer versions of the components and make use of the new functionality asap on the Oracle Big Data platforms. This will include an upgrade from 5.x to 6.0.1.

    Stay tuned for a more formal update with details on migration, versions, dates etc. which we will post here and on our blog in the next week or so.