X

Best Practices from Oracle Development's A‑Team

OIC Activity Stream to OCI Log analytics

Shreenidhi Raghuram
Consulting Solutions Architect

OIC Activity Stream to OCI Log analytics 

Introduction

We know that Oracle Integration Activity stream logs can be downloaded from OIC using the Monitoring console. Here is the reference link - Monitoring OIC 
A commonly implemented solution by customers is to automate the download of activity stream logs periodically using monitoring REST API and store them in repositories like FTP servers or Object storage for offline analysis and diagnosis. 

However the Activity stream download  is governed by size of the activity stream log file. Refer - activity stream logs retention.
Due to this size limitation, customers could have an issue with the ability to reliably download activity stream logs for a definite period of time, say last 1 hour. For instance, during periods of heavy activity on the OIC instance the log file may only cover a portion of the period due to the size limitation.

Solution

Good news ! This requirement has now been addressed as part of the August 2021 release of Oracle Integration.
OIC now allows activity streams to be sent to OCI Logging service. OCI Logging service provides persistence as well as real time analysis on the OIC activity stream messages.
Check for the August OIC update blog for list of new features - August 2021 OIC upgrade blog

Details

Configure Service Logging for OIC Activity Stream

Let us see some quick steps to integrate OIC Activity stream with OCI Logging.

Login to OCI console and locate the OIC instance from Developer Services -> Integration

Choose logs from Resources

On the Logs table, click on enable log button

This brings up the options to configure the Activity Stream logging for the OIC instance
Here are the options to configure

  •     Compartment - 
  •     Log Group 
  •     Log name
  •     Log retention (default 1 month) choose from available options up to 6 months
  •     Legacy archival

Refer here for more details on Log groups, legacy archival and other log configuration - managing OCI logs

    

Note that the log group can even reside in a different compartment from OIC instance. This could be useful to ensure that policy based access is provided only to the required groups of users to access the activity stream log analytics.

Once enabled, the OIC Service logging for Activity Streams will be available as shown below.

Refer to above screenshot of the created Integration Activity Stream logs page

Explore OIC Activity Stream Logs

Use the Activity Stream log page to view the OIC instance's activity stream messages. 
The time sort and time filters can be applied to narrow down messages to period of interest.

Use the Explore with Log Search link to navigate to log search page where one can search for activity streams by integration instance id, flow identifier and other custom filters.


For example a custom filter added as shown above can be used to analyze the number of email notifications delivered by hello World integration flow in a given period !

data.integrationFlowIdentifier='HELLO_WORLD!01.02.0000' and data.message=' Email notification sent successfully '

One can drill down into individual activity stream message, inspect the fields and add fields to custom filter criteria as shown below.

Commonly used search criteria can be saved for easy accessibility.

I hope this blog has been useful to introduce Activity Stream logging for Oracle Integration.

In further edition of this blog we'll dive deeper into additional use cases of using service connectors for further actions using OIC activity streams.

 

Be the first to comment

Comments ( 0 )
Please enter your name.Please provide a valid email address.Please enter a comment.CAPTCHA challenge response provided was incorrect. Please try again.Captcha