We know that Oracle Integration Activity stream logs can be downloaded from OIC using the Monitoring console. Here is the reference link - Monitoring OIC
A commonly implemented solution by customers is to automate the download of activity stream logs periodically using monitoring REST API and store them in repositories like FTP servers or Object storage for offline analysis and diagnosis.
However the Activity stream download is governed by size of the activity stream log file. Refer - activity stream logs retention.
Due to this size limitation, customers could have an issue with the ability to reliably download activity stream logs for a definite period of time, say last 1 hour. For instance, during periods of heavy activity on the OIC instance the log file may only cover a portion of the period due to the size limitation.
Good news ! This requirement has now been addressed as part of the August 2021 release of Oracle Integration.
OIC now allows activity streams to be sent to OCI Logging service. OCI Logging service provides persistence as well as real time analysis on the OIC activity stream messages.
Check for the August OIC update blog for list of new features - August 2021 OIC upgrade blog
Let us see some quick steps to integrate OIC Activity stream with OCI Logging.
Login to OCI console and locate the OIC instance from Developer Services -> Integration
Choose logs from Resources
On the Logs table, click on enable log button
This brings up the options to configure the Activity Stream logging for the OIC instance
Here are the options to configure
Refer here for more details on Log groups, legacy archival and other log configuration - managing OCI logs
Note that the log group can even reside in a different compartment from OIC instance. This could be useful to ensure that policy based access is provided only to the required groups of users to access the activity stream log analytics.
Once enabled, the OIC Service logging for Activity Streams will be available as shown below.
Refer to above screenshot of the created Integration Activity Stream logs page
Use the Activity Stream log page to view the OIC instance's activity stream messages.
The time sort and time filters can be applied to narrow down messages to period of interest.
Use the Explore with Log Search link to navigate to log search page where one can search for activity streams by integration instance id, flow identifier and other custom filters.
For example a custom filter added as shown above can be used to analyze the number of email notifications delivered by hello World integration flow in a given period !
data.integrationFlowIdentifier='HELLO_WORLD!01.02.0000' and data.message=' Email notification sent successfully '
One can drill down into individual activity stream message, inspect the fields and add fields to custom filter criteria as shown below.
Commonly used search criteria can be saved for easy accessibility.
I hope this blog has been useful to introduce Activity Stream logging for Oracle Integration.
In further edition of this blog we'll dive deeper into additional use cases of using service connectors for further actions using OIC activity streams.