tag:blogger.com,1999:blog-7480948824011837612024-03-19T02:17:39.563-05:00Xml and MoreTravel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.comBlogger371125tag:blogger.com,1999:blog-748094882401183761.post-65685212477838071552022-02-18T12:56:00.001-06:002022-02-18T12:56:04.803-06:00OAC―Editions of Oracle Analytics Cloud<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto;"><tbody><tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/a/AVvXsEjv-h_F-E8cifJSDNWetozQlK86YByQqZSDGhcCcDgg3CLdEXMBxV-DVq2BiSyD3Lp57r8QG0ctvpGEgRMPeRl99iAxOy40Nr5lH1A8MsFn26dKygSRSwlVI1NwkpdLLUjhT8IWlV0FypctMRky9vwBQJGA4adNeGzwIR4-kgB_d-8l2hX5GX6tljGi8Q=s518" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="291" data-original-width="518" height="412" src="https://blogger.googleusercontent.com/img/a/AVvXsEjv-h_F-E8cifJSDNWetozQlK86YByQqZSDGhcCcDgg3CLdEXMBxV-DVq2BiSyD3Lp57r8QG0ctvpGEgRMPeRl99iAxOy40Nr5lH1A8MsFn26dKygSRSwlVI1NwkpdLLUjhT8IWlV0FypctMRky9vwBQJGA4adNeGzwIR4-kgB_d-8l2hX5GX6tljGi8Q=w640-h412" width="560" /></a></td></tr><tr><td class="tr-caption" style="text-align: center;"><div><span style="font-family: inherit; font-size: small;"><b>Figure 1. </b> Provisioning an OAC instance</span></div><br /></td></tr></tbody></table><h2 style="text-align: left;">Subjects of Learning OAC</h2><ul style="text-align: left;"><li><span style="background-color: #fcff01; color: #800180;"> Describe the editions of Oracle Analytics Cloud</span></li><li> Describe the solutions applicable for each OAC edition</li><li> Identify the pre-requisites for OAC</li><li> Explain the concept of a compute shape</li></ul><div><br /></div>
<div class="separator" style="clear: both; text-align: center;"><iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen="" frameborder="0" height="315" src="https://www.youtube.com/embed/xSzXHRTAJ8o" title="YouTube video player" width="560"></iframe></div><div class="separator" style="clear: both; text-align: center;"><span style="font-family: inherit;"><b>Video 1.</b><span style="font-size: small;"> Create a Service with Oracle Analytics Cloud (YouTube </span><a href="https://www.youtube.com/watch?v=xSzXHRTAJ8o" target="_blank">link</a><span style="font-size: small;">)</span></span></div><div><br /></div><div><div class="sect2" style="box-sizing: border-box;"><h2>Oracle Analytics Cloud Products </h2><br />Oracle Analytics Cloud offers you three product options:<sup>[4]</sup><div style="box-sizing: border-box;"><div class="section" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__PRODUCTFLAVORS-7B23B8DA" style="box-sizing: border-box; margin: 14px 0px;"><div style="color: #333333;"><table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto;"><tbody><tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/a/AVvXsEizs1nJUg6SIx-pzJhPc8CsST9c3gA0Om08QEp8lhxbhL05AWMyVhPnq7eYspuZy_PLGuYn4SWrl2b-6Bmp9ZGjPmjCtQ4XmiMw9R-sxyGbErH1Z6zchd3T_9-bDcuHivcgutYeNyBZZRZ7lWxozzztC0n4S7EwqJFdl8mW-INJ8vBOPJZ0cxuvSN4ISg=s825" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="346" data-original-width="825" height="234" src="https://blogger.googleusercontent.com/img/a/AVvXsEizs1nJUg6SIx-pzJhPc8CsST9c3gA0Om08QEp8lhxbhL05AWMyVhPnq7eYspuZy_PLGuYn4SWrl2b-6Bmp9ZGjPmjCtQ4XmiMw9R-sxyGbErH1Z6zchd3T_9-bDcuHivcgutYeNyBZZRZ7lWxozzztC0n4S7EwqJFdl8mW-INJ8vBOPJZ0cxuvSN4ISg=w640-h268" width="560" /></a></td></tr><tr><td class="tr-caption" style="text-align: center;"><br /></td></tr></tbody></table></div><br /><h3 style="text-align: left;">Differences Between Products</h3><br />The main difference between Oracle Analytics Cloud, Oracle Analytics Cloud Subscription, and Oracle Analytics Cloud - Classic is the way you deploy and manage your services on Oracle Cloud.</div><div class="section" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__DIFFERENCESBETWEENPRODUCTSFLAVORS-7B23EBC7" style="box-sizing: border-box; margin: 14px 0px;"><ul style="text-align: left;"><li>Editions</li><li>Service Management</li><li>Infrastructure</li></ul></div><br /><h3 style="text-align: left;">Editions</h3></div><div style="box-sizing: border-box;"><br /></div><div style="box-sizing: border-box;">Several editions are currently available: <span style="background-color: #fcff01; color: #800180;">Professional</span> and <span style="background-color: #fcff01; color: #800180;">Enterprise</span>. The features available with each edition <span style="background-color: #fcff01; color: #800180;">depend on </span>the <span style="background-color: #fcff01; color: #800180;">product option</span><b><span style="background-color: #fcff01; color: #800180;"> </span></b><span style="color: #800180;"><span style="background-color: #fcff01;">and regions accessible to you</span></span>. Read [4] for details especially for the availability of different products based on dates and regions.<div class="section" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__EDITIONS-7B23EEEA" style="box-sizing: border-box; color: #333333; margin: 14px 0px;"><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/a/AVvXsEgwN_gj_KQmdHg5PMWaPOywce25ghGeP5eULjkfMBfiMVjdt4xzh-9xwDkATZZhhR1ajnmUPdS3bq3R1fEVVC0Hg_hfY4f1SvfAtsYC34_v0hrTniUyx0OcHHSXWlZMunodJrRgpIEcAh_OPqLkH-bhJzFL4dCpK6NX_Al0hqwj4YW3gqg-TSdyG4GAvg=s867" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="355" data-original-width="867" height="229" src="https://blogger.googleusercontent.com/img/a/AVvXsEgwN_gj_KQmdHg5PMWaPOywce25ghGeP5eULjkfMBfiMVjdt4xzh-9xwDkATZZhhR1ajnmUPdS3bq3R1fEVVC0Hg_hfY4f1SvfAtsYC34_v0hrTniUyx0OcHHSXWlZMunodJrRgpIEcAh_OPqLkH-bhJzFL4dCpK6NX_Al0hqwj4YW3gqg-TSdyG4GAvg=w640-h262" width="560" /></a></div></div><div class="section" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__EDITIONS-7B23EEEA" style="box-sizing: border-box; color: #333333; margin: 14px 0px;"><span style="font-family: inherit;"><br /></span></div><h3 style="box-sizing: border-box; color: #333333; margin: 14px 0px; text-align: left;"><span style="font-family: inherit;">Service Management</span></h3><div class="section" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__EDITIONS-7B23EEEA" style="box-sizing: border-box; color: #333333; margin: 14px 0px;"><span style="font-family: inherit;"><br /></span></div><div class="section" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__SERVICEMANAGEMENT-7B23FBCF" style="box-sizing: border-box; color: #333333; margin: 14px 0px;"><div class="tblformal" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__GUID-7307ADFA-099C-4D3C-9450-1E25EA7F7170" style="box-sizing: border-box;"><div class="table-responsive" style="box-sizing: border-box; min-height: 0.01%; overflow-x: auto;"><table border="1" cellpadding="4" cellspacing="0" class="Formal" frame="hsides" rules="rows" style="background-color: transparent; border-collapse: collapse; border-spacing: 0px; min-width: 420px; table-layout: fixed; width: 640px;" summary="" title=""><thead style="box-sizing: border-box;"><tr align="left" style="box-sizing: border-box;" valign="top"><th align="left" id="d1004e405" style="background: rgb(63, 63, 63); border-bottom-style: none; border-top-style: none; box-sizing: border-box; color: white; overflow-wrap: break-word; padding: 3pt; text-align: left;" valign="bottom" width="20%"><span style="font-family: inherit;">Service Management</span></th><th align="left" id="d1004e407" style="background: rgb(63, 63, 63); border-bottom-style: none; border-top-style: none; box-sizing: border-box; color: white; overflow-wrap: break-word; padding: 3pt; text-align: left;" valign="bottom" width="20%"><span style="box-sizing: border-box;"><span style="font-family: inherit;">Oracle Analytics Cloud</span></span></th><th align="left" id="d1004e410" style="background: rgb(63, 63, 63); border-bottom-style: none; border-top-style: none; box-sizing: border-box; color: white; overflow-wrap: break-word; padding: 3pt; text-align: left;" valign="bottom" width="20%"><span style="font-family: inherit;"><span style="box-sizing: border-box;">Oracle Analytics Cloud</span>Subscription</span></th><th align="left" id="d1004e414" style="background: rgb(63, 63, 63); border-bottom-style: none; border-top-style: none; box-sizing: border-box; color: white; overflow-wrap: break-word; padding: 3pt; text-align: left;" valign="bottom" width="20%"><span style="box-sizing: border-box;"><span style="font-family: inherit;">Oracle Analytics Cloud - Classic</span></span></th></tr></thead><tbody style="box-sizing: border-box;"><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e419" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span class="bold" style="box-sizing: border-box; font-weight: bold;"><span style="font-family: inherit;">Managed by You (Oracle User)</span></span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__GUID-93B10971-1176-49E8-BF78-8DDAB9C46F43" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div><div style="box-sizing: border-box; margin-top: 14px;"><span style="font-family: inherit;">You manage the service lifecycle and configuration, and have SSH access to the compute node VM.</span></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e436" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span class="bold" style="box-sizing: border-box; font-weight: bold;"><span style="font-family: inherit;">Oracle–Managed</span></span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__GUID-B5236FBB-4804-407E-BF4B-0B8785E88B3C" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div><div style="box-sizing: border-box; margin-top: 14px;"><span style="font-family: inherit;">Oracle provides you with lifecycle management and configuration. You can log service requests to Oracle Cloud support to request service updates.</span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__FIG_YRL_SBN_ZGB" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__IMAGE_ZRL_SBN_ZGB" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e455" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"><span class="bold" style="box-sizing: border-box; font-weight: bold;"><span style="font-family: inherit;">Customer Responsibility</span></span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e466" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span style="font-family: inherit;">Manage users and roles</span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__GUID-18C93C9C-F606-41DA-8228-1226E0C2C5B3" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__FIG_ZHP_5BN_ZGB" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__IMAGE_A3P_5BN_ZGB" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__CHECKMARK-7EA9C2D6" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e484" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span style="font-family: inherit;">Create and size service</span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__GUID-833505B1-6DFC-42AC-BD63-14C531028D03" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__FIG_DF1_VBN_ZGB" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__IMAGE_EF1_VBN_ZGB" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__GUID-FEA22BF4-BA97-453A-AEFB-3822B5954C76" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e502" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span style="font-family: inherit;">Create database cloud service</span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__CHECKMARK-7EA9D8D8" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e514" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span style="font-family: inherit;">Administer database cloud service</span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__CHECKMARK-7EA9DC75" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e526" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span style="font-family: inherit;">Back up and restore services</span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span style="font-family: inherit;">Oracle schedules and manages backups</span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span style="font-family: inherit;">Oracle schedules and manages backups</span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__CHECKMARK-7EA9DFB8" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e538" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span style="font-family: inherit;">Patch services</span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span style="font-family: inherit;">Oracle schedules and applies patches</span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span style="font-family: inherit;">Oracle schedules and applies patches</span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__CHECKMARK-7EA9E369" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e550" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span style="font-family: inherit;">Patch operating system</span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span style="font-family: inherit;">Oracle schedules and applies patches</span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span style="font-family: inherit;">Oracle schedules and applies patches</span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__CHECKMARK-7EA9E796" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e562" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span style="font-family: inherit;">Start and stop services</span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="p" style="box-sizing: border-box; margin: 14px 0px;"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__FIG_PVX_HNM_BHB" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__IMAGE_QVX_HNM_BHB" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e562" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span face=""Oracle Sans", -apple-system, BlinkMacSystemFont, "Segoe UI", "Helvetica Neue", Arial, sans-serif" style="color: #1a1816;">Pause and resume services</span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="p" style="box-sizing: border-box; margin: 14px 0px;"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__FIG_PVX_HNM_BHB" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__IMAGE_QVX_HNM_BHB" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td></tr><tr align="left" style="border-bottom: 2px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e576" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span style="font-family: inherit;">Monitor services</span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span style="font-family: inherit;">Oracle has direct access to diagnostic logs for troubleshooting issues</span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span style="font-family: inherit;">Oracle has direct access to diagnostic logs for troubleshooting issues</span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__CHECKMARK-7EA9EB83" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td></tr></tbody></table></div></div></div><div class="section" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__INFRASTRUCTURE-7B240183" style="box-sizing: border-box; color: #333333; margin: 14px 0px;"><h3 style="box-sizing: border-box; font-weight: bold; margin-bottom: 14px; margin-top: 14px; padding-top: 10px; text-align: left;"><span style="font-family: inherit;">Infrastructure</span></h3><div class="tblformal" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__GUID-0EDF2C5A-F6FC-44C8-B314-4C48E2C3F077" style="box-sizing: border-box;"><div class="table-responsive" style="box-sizing: border-box; min-height: 0.01%; overflow-x: auto;"><table border="1" cellpadding="4" cellspacing="0" class="Formal" frame="hsides" rules="rows" style="background-color: transparent; border-collapse: collapse; border-spacing: 0px; min-width: 420px; table-layout: fixed; width: 640px;" summary="" title=""><thead style="box-sizing: border-box;"><tr align="left" style="box-sizing: border-box;" valign="top"><th align="left" id="d1004e602" style="background: rgb(63, 63, 63); border-bottom-style: none; border-top-style: none; box-sizing: border-box; color: white; overflow-wrap: break-word; padding: 3pt; text-align: left;" valign="bottom" width="20%"><span style="font-family: inherit;">Infrastructure</span></th><th align="left" id="d1004e604" style="background: rgb(63, 63, 63); border-bottom-style: none; border-top-style: none; box-sizing: border-box; color: white; overflow-wrap: break-word; padding: 3pt; text-align: left;" valign="bottom" width="20%"><span style="box-sizing: border-box;"><span style="font-family: inherit;">Oracle Analytics Cloud</span></span></th><th align="left" id="d1004e608" style="background: rgb(63, 63, 63); border-bottom-style: none; border-top-style: none; box-sizing: border-box; color: white; overflow-wrap: break-word; padding: 3pt; text-align: left;" valign="bottom" width="20%"><span style="font-family: inherit;"><span style="box-sizing: border-box;">Oracle Analytics Cloud</span>Subscription</span></th><th align="left" id="d1004e612" style="background: rgb(63, 63, 63); border-bottom-style: none; border-top-style: none; box-sizing: border-box; color: white; overflow-wrap: break-word; padding: 3pt; text-align: left;" valign="bottom" width="20%"><span style="box-sizing: border-box;"><span style="font-family: inherit;">Oracle Analytics Cloud - Classic</span></span></th></tr></thead><tbody style="box-sizing: border-box;"><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e617" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span class="bold" style="box-sizing: border-box; font-weight: bold;"><span style="font-family: inherit;">Oracle Cloud Infrastructure (Gen 2)</span></span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__GUID-EF483F9A-3D60-4452-A511-D268DC49CCE4" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__FIG_C5Y_CCN_ZGB" style="box-sizing: border-box;"><br /></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e617" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span class="bold" style="box-sizing: border-box; font-weight: bold;"><span style="font-family: inherit;">Oracle Cloud Infrastructure (Gen 1)</span></span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__GUID-EF483F9A-3D60-4452-A511-D268DC49CCE4" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__FIG_C5Y_CCN_ZGB" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__IMAGE_D5Y_CCN_ZGB" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e634" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><span class="bold" style="box-sizing: border-box; font-weight: bold;"><span style="font-family: inherit;">Oracle Cloud Infrastructure Classic</span></span></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__GUID-E3AE456B-9A58-42D0-8163-F624BEF66077" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e648" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"><span class="bold" style="box-sizing: border-box; font-weight: bold;"><span style="font-family: inherit;">Oracle Cloud Infrastructure Identity and Access Management- Identity Domains</span></span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__GUID-40F4F92A-F778-42F8-86A4-16C968D2CEB9" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__GUID-40F4F92A-F778-42F8-86A4-16C968D2CEB9" style="box-sizing: border-box;"><span style="color: #333333;">Available on Oracle Cloud Infrastructure (Gen 2) to new customers in some Oracle Cloud regions.</span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__FIG_C1T_DCN_ZGB" style="box-sizing: border-box;"><br /></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__GUID-CCE20177-DF55-4249-B271-2D164AACC90A" style="box-sizing: border-box;"><br /></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e648" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"><span class="bold" style="box-sizing: border-box; font-weight: bold;"><span style="font-family: inherit;">Oracle Identity Cloud Service</span></span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__GUID-40F4F92A-F778-42F8-86A4-16C968D2CEB9" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__FIG_C1T_DCN_ZGB" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__IMAGE_D1T_DCN_ZGB" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__GUID-CCE20177-DF55-4249-B271-2D164AACC90A" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e669" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"><span class="bold" style="box-sizing: border-box; font-weight: bold;"><span style="font-family: inherit;">Load Balancer</span></span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__CHECKMARK-7EA9F888" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div><div style="box-sizing: border-box; margin-top: 14px;"><span style="font-family: inherit;">An Oracle-managed load balancer is automatically created and configured for your service.</span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__FIG_KY3_2CN_ZGB" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__IMAGE_LY3_2CN_ZGB" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div><div style="box-sizing: border-box; margin-top: 14px;"><span style="font-family: inherit;">An Oracle-managed load balancer is automatically created and configured for your service.</span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__CHECKMARK-7EA9F4D1" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div><div style="box-sizing: border-box; margin-top: 14px;"><span style="font-family: inherit;">When you enable <span style="box-sizing: border-box;">Oracle Identity Cloud Service</span> as the identity provider, an Oracle-managed load balancer is created and configured automatically for your service.</span></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e698" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"><span class="bold" style="box-sizing: border-box; font-weight: bold;"><span style="font-family: inherit;">Cloud Storage Required</span></span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__CHECKMARK-7EAA0026" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div><div style="box-sizing: border-box; margin-top: 14px;"><span style="font-family: inherit;">Uses <span style="box-sizing: border-box;">Oracle Cloud Infrastructure Object Storage</span>— A storage bucket is automatically created for your service.</span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__FIG_PD5_FCN_ZGB" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__IMAGE_QD5_FCN_ZGB" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div><div style="box-sizing: border-box; margin-top: 14px;"><span style="font-family: inherit;">Uses <span style="box-sizing: border-box;">Oracle Cloud Infrastructure Object Storage</span>— A storage bucket is automatically created for your service.</span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__CHECKMARK-7EA9FC46" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div><div style="box-sizing: border-box; margin-top: 14px;"><span style="font-family: inherit;">Uses <span style="box-sizing: border-box;">Oracle Cloud Infrastructure Object Storage Classic</span> — You can create the object storage container either before or while you set up your service.</span></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e733" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"><span class="bold" style="box-sizing: border-box; font-weight: bold;"><span style="font-family: inherit;"><span style="box-sizing: border-box;">Oracle Database Cloud Service</span> Required</span></span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__CHECKMARK-7EAA03F4" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div><div style="box-sizing: border-box; margin-top: 14px;"><span style="font-family: inherit;">You must set up a database service for <span style="box-sizing: border-box;">Oracle Analytics Cloud - Classic</span> schemas and organize a back up schedule.</span></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e754" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"><span class="bold" style="box-sizing: border-box; font-weight: bold;"><span style="font-family: inherit;">Size Deployment by Shape</span></span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__FIG_UQV_K3Y_RGB" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__IMAGE_VQV_K3Y_RGB" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div><div style="box-sizing: border-box; margin-top: 14px;"><span style="font-family: inherit;">Various Oracle Compute Unit (OCPU) sizing options.</span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__FIG_I3K_HCN_ZGB" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__IMAGE_J3K_HCN_ZGB" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div><div style="box-sizing: border-box; margin-top: 14px;"><span style="font-family: inherit;">Various Oracle Compute Unit (OCPU) sizing options.</span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__FIG_WQV_K3Y_RGB" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__IMAGE_XQV_K3Y_RGB" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div><div style="box-sizing: border-box; margin-bottom: 14px; margin-top: 14px;"><span style="font-family: inherit;">Standard and high memory shapes.</span></div><div style="box-sizing: border-box; margin-top: 14px;"><span style="font-family: inherit;">The list of available shapes may vary by region.</span></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e754" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"><span class="bold" style="box-sizing: border-box; font-weight: bold;"><span style="font-family: inherit;">Size Deployment by </span></span><span style="background-color: transparent; color: #333333;"><b>Number of Users</b></span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__FIG_UQV_K3Y_RGB" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__IMAGE_VQV_K3Y_RGB" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div><div style="box-sizing: border-box; margin-top: 14px;"><span style="font-family: inherit;">Only on Oracle Cloud Infrastructure (Gen 2).</span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__FIG_I3K_HCN_ZGB" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__IMAGE_J3K_HCN_ZGB" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div><div style="box-sizing: border-box; margin-top: 14px;"><br /></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__FIG_WQV_K3Y_RGB" style="box-sizing: border-box;"><br /></div><div style="box-sizing: border-box; margin-bottom: 14px; margin-top: 14px;"><br /></div></td></tr><tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e797" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"><span class="bold" style="box-sizing: border-box; font-weight: bold;"><span style="font-family: inherit;">Scale Up and Scale Down</span></span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="p" style="box-sizing: border-box; margin: 14px 0px;"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__FIG_CWJ_CNM_BHB" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__IMAGE_DWJ_CNM_BHB" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__GUID-B1E63450-B566-405F-AF51-6613B92CC1E1" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div></td></tr><tr align="left" style="border-bottom: 2px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1004e817" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"><span class="bold" style="box-sizing: border-box; font-weight: bold;"><span style="font-family: inherit;">Availability Domains</span></span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__CHECKMARK-7EAA1005" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div><div style="box-sizing: border-box; margin-top: 14px;"><span style="font-family: inherit;">Each region has multiple isolated availability domains, with separate power and cooling. The availability domains within a region are interconnected using a low-latency network. When you create a service, you can select the region where you want to deploy the service and Oracle automatically selects an availability domain.</span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div class="figure" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__FIG_NNZ_FDN_ZGB" style="box-sizing: border-box;"><span style="font-family: inherit;"><img alt="Check mark" id="GUID-211E3547-0A88-4ACB-8F49-74343092F2B5__IMAGE_ONZ_FDN_ZGB" src="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/img/checkmark.gif" style="border: 0px; box-sizing: border-box; max-width: 100%; vertical-align: middle;" title="Check mark" /></span></div><div style="box-sizing: border-box; margin-top: 14px;"><span style="font-family: inherit;">Each region has multiple isolated availability domains, with separate power and cooling. The availability domains within a region are interconnected using a low-latency network. When you create a service, you can select the region where you want to deploy the service and Oracle automatically selects an availability domain.</span></div></td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="20%"><div style="box-sizing: border-box;"></div></td></tr></tbody></table></div></div></div></div></div><div class="sect2" style="box-sizing: border-box;"><span style="color: #333333; font-family: inherit;"><a href="https://www.blogger.com/null" id="GUID-C5F5B781-BF3C-4985-8B89-9638568EBBFF" name="GUID-C5F5B781-BF3C-4985-8B89-9638568EBBFF" style="background-color: transparent; box-sizing: border-box; color: #226aa8;"></a></span><br /><br /><h3 style="text-align: left;">Oracle Analytics Cloud - Professional Edition</h3><br />With Professional Edition, you can:<br /><ul style="text-align: left;"><li>Take control of your data</li><li>Create processes for business analytics application and data collection</li><li>Discover insights on the data that you provide</li><li>Prepare data through interactive data flows</li><li>Explore data through grammar-based visualization</li><li>Coordinate business analytics within your department or organization</li><li>Use the Oracle Analytics Day by Day mobile application</li></ul></div><div class="sect2" style="box-sizing: border-box;"><br /><h3 style="text-align: left;">Oracle Analytics Cloud - Enterprise Edition</h3></div><div class="sect2" style="box-sizing: border-box;"><br />Enterprise Edition offers all the features in Professional Edition and in addition, you can:<br /><ul style="text-align: left;"><li>Build data models, reports, and analytic dashboards in an enterprise business intelligence environment</li><li>Design and publish pixel-perfect reports from your enterprise data</li><li>Migrate content from your existing on-premises environment</li><li>Perform a sensitivity analysis to test various data scenarios</li><li>Use the Oracle Analytics Day by Day mobile application</li><li>Maintain live and optimized connectivity to on-premises data warehouses</li></ul><div><br /></div></div><h2 style="box-sizing: border-box; margin: 0px 0px 1em; text-align: left;"><span style="box-sizing: border-box; font-family: inherit;">References</span></h2></div><div style="box-sizing: border-box; margin: 0px 0px 1em;"><ol><li><span style="box-sizing: border-box;"><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acoci/create-services.html#GUID-47022452-65CC-4345-8F7F-A447BB24A48A" target="_blank">Create Services with Oracle Analytics Cloud</a></span></li><li><a href="https://learn.oracle.com/ols/course/better-business-decisions-with-oracle-business-analytics/35573/59371 " target="_blank">Better Business Decisions with Oracle Business Analytics</a></li><li>"<a href="https://learn.oracle.com/ols/course/best-practices-for-implementing-analytics-cloud/35573/78341" target="_blank">Best Practices for implementing Analytics Cloud</a>" from Oracle University</li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/what-is-oracle-analytics-cloud.html#GUID-E68C8A55-1342-43BB-93BC-CA24E353D873" target="_blank">What Is Oracle Analytics Cloud?</a></li></ol></div>Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com6tag:blogger.com,1999:blog-748094882401183761.post-69419278335418441792021-06-30T10:34:00.006-05:002021-06-30T12:29:52.102-05:00Windows—Want to Sort Files by Type and Date ModifiedRecently, I need to retire a Windows 10 laptop and migrate its contents to a new one. Then the below question was asked in my mind:<br /><div><blockquote><div><i>Can I do a 2-tiered sort of files: sort by <b>type </b>then by <b>Date modified</b>?</i></div></blockquote><div>In this article, we will demonstrate how to achieve that.</div><div><br /></div><table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto;"><tbody><tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiAbo5Yt-BQeQldHidLUzhKUAzhQS7PDPpbSTLY4I9nn1zi7RzC85l3ibPEhjlbzLxaRIUTDTKKGPDRxgzKq-Ra6iL3Uk0S9A_8Ge0V8YeppnRnuWO5YcavvfhLTyYOOCXiAp4qQVPiRuNQ/s800/2tierSort.png" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="152" data-original-width="800" height="122" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiAbo5Yt-BQeQldHidLUzhKUAzhQS7PDPpbSTLY4I9nn1zi7RzC85l3ibPEhjlbzLxaRIUTDTKKGPDRxgzKq-Ra6iL3Uk0S9A_8Ge0V8YeppnRnuWO5YcavvfhLTyYOOCXiAp4qQVPiRuNQ/w640-h122/2tierSort.png" width="640" /></a></td></tr><tr><td class="tr-caption" style="text-align: center;"><b>Figure 1. File Explorer</b> with <b>View </b>tab selected in Windows 10 </td></tr></tbody></table><br /><div><br /></div><h2 style="text-align: left;">Sorting Files and Folders</h2><div><br /></div>"Sorting files and folders" reorders them in <b>File Explorer</b> based on the criteria you prefer. There are over 300 criteria available, and you can apply whichever you prefer. </div><div style="text-align: left;"><blockquote>Open a <b>File Explorer </b>(see Figure 1)<br /><ol><li>To open <b>File Explorer</b>, click on the <b>File Explorer</b> icon located in the taskbar.</li><li>Alternatively, you can open <b>File Explorer</b> by clicking on the <b>Start</b> button and then clicking on <b>File Explorer</b>.</li></ol></blockquote></div><div><b>By default</b>, in Windows 10, your files and folders are <b>sorted in Ascending order by Name</b> - or alphabetically - <b>except for the Downloads folder</b>, which is <b>sorted in Descending order by Date modified</b> - newest downloads are displayed on top.<div><br /></div><table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto;"><tbody><tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEigsrqNEXtZu0pmw5hCUtBhGKKOj8FYwfqlKXhgOxTellMNhzmH6biVxCTjvaiDVEVNpZk7Ls8pT9KNFkyav19PPKg7wrLEXY6UUjOadgSH14Ui7rfB6Uk0aN_AWISXWbELWFSWNaVR7cqp/s604/sortBy.png" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="504" data-original-width="604" height="334" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEigsrqNEXtZu0pmw5hCUtBhGKKOj8FYwfqlKXhgOxTellMNhzmH6biVxCTjvaiDVEVNpZk7Ls8pT9KNFkyav19PPKg7wrLEXY6UUjOadgSH14Ui7rfB6Uk0aN_AWISXWbELWFSWNaVR7cqp/w400-h334/sortBy.png" width="400" /></a></td></tr><tr><td class="tr-caption" style="text-align: center;"><b>Figure 2.</b> Sort by <b>Date modified</b> in Descending order</td></tr></tbody></table><br /><div><br /><h2 style="text-align: left;">How to Cleanup Old Files in a Folder?</h2><div style="text-align: left;"><br /></div><div style="text-align: left;">To figure out which file needs to be kept and which not during a laptop migration, it will be nice to sort files first <b>by Type</b> and then <b>by Date modified</b>.</div><p>Here is how you can achieve that in Windows 10:</p><ol style="text-align: left;"><li>Click <b>View</b>, and select <b>Details</b></li><li>Click <b>Group by</b>, and select <b>Type</b> (default: <b>Ascending</b>) </li><li>Click <b>Sort by</b>, and select <b>Date modified</b> (default: <b>Descending</b>) </li><ul><li>You can also click on <b>Date modified</b> column header to change its sort order (note that it's a toggle).</li></ul></ol><br /></div><table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto;"><tbody><tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhqjWrOIq1uJ27W77EK0EeLW6F-abS6bDO9GeEn7av0b8tI3oSMGyOsr52odwNPPf2LH7EjxDywdFB2pufWyVvN2a8ov6Oodg_z-Q216wChSrM_vJc8I7SbjDrzQsGU1jv7Bd92uEjg3ynR/s800/sortResult.png" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="328" data-original-width="800" height="262" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhqjWrOIq1uJ27W77EK0EeLW6F-abS6bDO9GeEn7av0b8tI3oSMGyOsr52odwNPPf2LH7EjxDywdFB2pufWyVvN2a8ov6Oodg_z-Q216wChSrM_vJc8I7SbjDrzQsGU1jv7Bd92uEjg3ynR/w640-h262/sortResult.png" width="640" /></a></td></tr><tr><td class="tr-caption" style="text-align: center;"><b>Figure 3.</b> Final result (2-tiered sort of files: sort by <b>type </b>and then by <b>Date modified</b>)</td></tr></tbody></table><br /></div>Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com26tag:blogger.com,1999:blog-748094882401183761.post-54052831438405692052021-03-05T13:20:00.017-06:002022-06-29T10:24:54.899-05:00RDG—Oracle Analytics Cloud Remote Data Gateway<div>You can connect to remote on-premise data sources from Oracle Analytics Cloud. This e<b>nables you to deploy Oracle Analytics Cloud with large on-premise data sets</b> <span style="background-color: #fcff01; color: #800180;">without migrating the data to the cloud</span>. Users can analyze the data in <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/visualize-data.html" target="_blank">data visualizations</a>, and in reporting dashboards and analyses.<br /><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsds/connect-premise-data-sources.html#GUID-55688AF3-8537-4055-9649-B2F51826E722" target="_blank"></a><blockquote><i><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsds/connect-premise-data-sources.html#GUID-55688AF3-8537-4055-9649-B2F51826E722" target="_blank">Oracle Analytics Cloud Data Gateway</a> (which supersedes <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsds/connect-premise-data-sources.html#GUID-D5FC7825-4467-4D55-8572-F2972DE231D7" target="_blank">Remote Data Connector</a>) enables you to query <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsds/connect-premise-data-sources.html#GUID-E229598F-D5D1-482A-88E6-5B66507AED6A" target="_blank">on-premises data sources</a> from Oracle Analytics Cloud.</i></blockquote><p>Note that <span style="background-color: #fcff01; color: #800180;">a new feature named <a href="https://www.ateam-oracle.com/enabling-oracle-analytics-cloud-private-access-channel" target="_blank">private access channel</a> (PAC)</span> was also introduced for the Oracle Analytics Cloud (OAC) Gen 2 instances since 5.9. Here are the high-level descriptions of of it:<sup>[14]</sup></p><blockquote><i><b>Private Access Channel</b> compliments and <span style="background-color: #fcff01; color: #800180;">provides an alternative to Remote Data Gateway (RDG)</span> for the private data sources it supports. Both PAC and RDG may be used within the same instance of OAC. There may be sources that PAC supports and RDG does not and vice-versa.</i></blockquote></div><div><br /><table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto;"><tbody><tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjfPE6DO0l6uiv_wAP-yzXc8SgfHeUTN352u793XiE_e6CzJGFNFuar5b7Cu2fbl9fSnwNSDJWrywYnCPAsfBrR0uMbrR_73S1VtuHiG1utFSJyX7kdCHKIyZGo4p81L7VE03-QUcPt4qge/s1146/DataGatewayArchitecture.png" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="293" data-original-width="1146" height="144" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjfPE6DO0l6uiv_wAP-yzXc8SgfHeUTN352u793XiE_e6CzJGFNFuar5b7Cu2fbl9fSnwNSDJWrywYnCPAsfBrR0uMbrR_73S1VtuHiG1utFSJyX7kdCHKIyZGo4p81L7VE03-QUcPt4qge/w640-h164/DataGatewayArchitecture.png" width="560" /></a></td></tr><tr><td class="tr-caption" style="text-align: center;"><div style="text-align: left;"><b style="font-size: small;">Figure 1. </b><span style="font-size: small;">Data Gateway Architecture (Source: [11]) . The callouts are</span></div><span style="font-size: x-small;"><div style="text-align: left;"><span> </span>1. Oracle Analytics Cloud issues and <span style="background-color: #fcff01; color: #800180;">queues </span>queries using Data Gateway queue.</div><div style="text-align: left;"><span> </span>2. The agent looks for queries to process via <span style="background-color: #fcff01; color: #800180;">long-polling</span>.</div><div style="text-align: left;"><span> </span>3. The agent executes the queries.</div><div style="text-align: left;"><span> </span>4. The agent sends the query results to Oracle Analytics Cloud.</div></span></td></tr></tbody></table><div class="separator" style="clear: both; text-align: center;"><br /></div></div><h3 style="text-align: left;"><span style="font-weight: normal;"><span style="font-size: large;">Data Gateway Architecture</span></span></h3><div><br /></div>Figure 1 shows a high-level diagram of the architecture for Data Gateway. <div><br /></div><div>Oracle Analytics Cloud communicates through a firewall with an on-premise database using HTTPS, with an agent installed in the <b>on-premise environment</b> that channels database queries between Oracle Analytics Cloud and the on-premise database. </div><div><blockquote style="text-align: center;"><b><i>On-premise Environment</i></b></blockquote><blockquote><i><span style="color: #1a1816;">You </span><span style="background-color: #fcff01; color: #800180;">install Data Gateway in a subnet that gives visibility to both <span style="box-sizing: border-box;">Oracle Analytics Cloud</span> and the target data sources</span><span style="color: #1a1816;">. Your network needs to allow outgoing (egress) traffic from the node where Data Gateway is installed to the public internet on port 443 so that Data Gateway can communicate with </span><span style="box-sizing: border-box; color: #1a1816;">Oracle Analytics Cloud</span><span style="color: #1a1816;">. In addition, the network needs to allow outgoing (egress) traffic from the Data Gateway agent to the data source.</span> </i></blockquote><blockquote><i><span style="color: #1a1816;"> For example, you might test the network by opening a browser on the node where Data Gateway is installed and connect to </span><span style="box-sizing: border-box; color: #1a1816;">Oracle Analytics Cloud</span><span style="color: #1a1816;">. You might also test the connection from the same node to the data source using a generic JDBC tool.</span></i></blockquote><span style="color: #1a1816;"></span></div><div>Data Gateway regularly communicates with Oracle Analytics Cloud to see whether Oracle Analytics Cloud has queries that need processing, a process known as <span style="background-color: #fcff01; color: #800180;">long-polling</span>. Data Gateway makes a long-running TLS-encrypted HTTP request to Oracle Analytics Cloud and waits until Oracle Analytics Cloud has a query to process. If there're no queries from Oracle Analytics Cloud after two minutes, Data Gateway terminates and re-issues the request in order to avoid the request being identified and terminated as an idle or stale connection by the network.</div><div><span style="color: #1a1816;"><i></i></span><blockquote><i><span style="color: #1a1816;">The HTTPS communication between Data Gateway and </span><span style="box-sizing: border-box; color: #1a1816;">Oracle Analytics Cloud</span><span style="color: #1a1816;"> leverages the SSL certificate of your </span><span style="box-sizing: border-box; color: #1a1816;">Oracle Analytics Cloud</span><span style="color: #1a1816;"> service instance. </span><span style="background-color: #fcff01; color: #800180;">The same certificate is used to encrypt your browser connections to <span style="box-sizing: border-box;">Oracle Analytics Cloud</span></span><span style="color: #1a1816;">.</span></i></blockquote><span style="color: #1a1816;"></span></div><div><span style="color: #1a1816;"></span><br /><h3 style="text-align: left;"><span style="font-weight: normal;"><span style="font-size: large;">Data Gateway vs Remote Data Connector</span></span></h3><div><br /></div><div><p style="box-sizing: border-box; color: #1a1816; font-stretch: normal; line-height: 1.44; margin: 14px 0px;"><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsds/connect-premise-data-sources.html#GUID-55688AF3-8537-4055-9649-B2F51826E722" target="_blank">Data Gateway</a> replaces the <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsds/connect-premise-data-sources.html#GUID-D5FC7825-4467-4D55-8572-F2972DE231D7" target="_blank">Remote Data Connector</a> utility that was used in earlier releases. Although you can still use Remote Data Connector, Oracle recommend that you use Data Gateway. Data Gateway has many advantages over Remote Data Connector:</p><ul id="GUID-F6D0D5A5-E47F-4940-ADAB-B217D63934A9__UL_CHH_MLD_Y3B" style="box-sizing: border-box; margin-bottom: 10px; margin-top: 0px;"><li style="box-sizing: border-box; margin-bottom: 0.5em; margin-top: 0.5em;">You can deploy multiple Data Gateway agents to query the same database. This <span style="background-color: #fcff01; color: #800180;">provides failover and a highly-available architecture</span>.</li><li style="box-sizing: border-box; margin-bottom: 0.5em; margin-top: 0.5em;">In Remote Data Connector, the <span style="background-color: #fcff01; color: #800180;">c</span><span style="background-color: #fcff01; color: #800180;">ommunication is initiated by <span style="box-sizing: border-box;">Oracle Analytics Cloud</span></span>. In Data Gateway, the <span style="background-color: #fcff01; color: #800180;">communication is initiated by Data Gateway</span>. As a result:<ul id="GUID-F6D0D5A5-E47F-4940-ADAB-B217D63934A9__UL_XNJ_BMD_Y3B" style="box-sizing: border-box; list-style-type: disc; margin-bottom: 0px; margin-top: 0px;"><li style="box-sizing: border-box; margin-bottom: 0.5em; margin-top: 0.5em;">You don't need to install anything in a network demilitarized zone (DMZ).</li><li style="box-sizing: border-box; margin-bottom: 0.5em; margin-top: 0.5em;">You don't have to open ports for ingress traffic in the on-premises firewall.</li><li style="box-sizing: border-box; margin-bottom: 0.5em; margin-top: 0.5em;">You don't have to register your <span style="box-sizing: border-box;">Oracle Analytics Cloud</span> as a 'safe' domain.</li></ul></li></ul></div><div>Note that you cannot <span style="color: #1a1816;">use Data Gateway and Remote Data Connector at the same time with your </span><span style="box-sizing: border-box; color: #1a1816;">Oracle Analytics Cloud</span><span style="color: #1a1816;"> instance.</span></div><div><span style="color: #1a1816;"><br /></span><h3 style="text-align: left;"><span style="font-weight: normal;"><span style="font-size: large;">Server Deployment vs Personal Deployment</span></span></h3><div><p class="subhead3" id="GUID-F6D0D5A5-E47F-4940-ADAB-B217D63934A9__GUID-48165759-2BCB-45EE-858E-A08AF86484F2" style="box-sizing: border-box; font-stretch: normal; line-height: 1.44; margin: 14px 0px; padding-top: 10px;"><span style="color: #1a1816;">Data Gateway supports two kinds of deployment:</span><br /></p><ul style="text-align: left;"><li><b>Server Deployment</b></li><ul><li><span style="color: #1a1816;">You can use Oracle Universal Installer to install on Linux</span></li><li><span color="inherit" style="font-family: inherit;">You can have multiple Data Gateway agents on each node (physical or virtual)</span></li><li><span style="color: #1a1816;">You can edit Data Gateway properties in </span></li><ul><li><span style="color: #1a1816;"><Installed location>/jetty/obiee_rdc_agent.properties</span></li></ul></ul><li><b>Personal Deployment</b></li><ul><li><span style="color: #1a1816;">You can copy the binary files onto MacOS or Windows</span></li><li>You can edit Data Gateway properties in </li><ul><li><Installed location>\obiee_rdc_agent.properties</li></ul></ul></ul><div><br /></div></div></div></div><div><div><div class="sect3" style="box-sizing: border-box;"><h3 style="background-attachment: initial; background-clip: initial; background-image: initial; background-origin: initial; background-position: initial; background-repeat: initial; background-size: initial; box-sizing: border-box; color: inherit; font-family: inherit; font-weight: 400; line-height: 1.1; margin-bottom: 10px; margin-top: 10px; text-align: left;"><span style="font-size: large;">High Availability</span></h3><h4 class="sect4" id="ACSDS-GUID-2E2592AD-36B5-4AF1-933D-AE1B9C0FE970" style="background-attachment: initial; background-clip: initial; background-image: initial; background-origin: initial; background-position: initial; background-repeat: initial; background-size: initial; box-sizing: border-box; line-height: 1.1; margin-bottom: 10px; margin-top: 10px;"><br /><span style="font-weight: normal;">High Availability is supported for Data Gateway and </span><span style="background-color: #fcff01; color: #800180; font-weight: normal;">Oracle recommends at least two Data Gateways per <span style="box-sizing: border-box; font-family: inherit;">Oracle Analytics Cloud</span><span style="font-family: inherit;"> instance</span></span><span style="color: #1a1816; font-family: inherit; font-weight: 400;">. </span></h4><h4 class="sect4" id="ACSDS-GUID-2E2592AD-36B5-4AF1-933D-AE1B9C0FE970" style="background-attachment: initial; background-clip: initial; background-image: initial; background-origin: initial; background-position: initial; background-repeat: initial; background-size: initial; box-sizing: border-box; line-height: 1.1; margin-bottom: 10px; margin-top: 10px;"></h4><h4 style="text-align: left;">How HA is supported?</h4><ul style="text-align: left;"><li><span style="font-weight: normal;">On the Oracle Analytics Cloud side, high availability is provided natively.</span></li><li><span style="font-weight: normal;">On the Data Gateway side, you set up high availability by deploying two Data Gateways for each Oracle Analytics Cloud instance.</span></li><ul><li><span style="font-weight: normal;">However, all of these agents must be capable of servicing all remote queries (that is, you cannot configure one agent to service queries for one data source only, and another agent to service queries for a different data source).</span></li></ul></ul><div><span style="font-weight: normal;"><br /></span></div><h4 class="sect4" id="ACSDS-GUID-2E2592AD-36B5-4AF1-933D-AE1B9C0FE970" style="background-attachment: initial; background-clip: initial; background-image: initial; background-origin: initial; background-position: initial; background-repeat: initial; background-size: initial; box-sizing: border-box; color: inherit; font-family: inherit; font-weight: 400; line-height: 1.1; margin-bottom: 10px; margin-top: 10px;"><span style="font-size: large;">Troubleshoot Data Gateway</span></h4><div style="box-sizing: border-box;"><p style="box-sizing: border-box; color: #1a1816; font-stretch: normal; line-height: 1.44; margin: 14px 0px;">Here's how to troubleshoot common setup issues with Data Gateway.</p><div class="section" style="box-sizing: border-box; margin: 14px 0px;"><div class="tblformal" id="GUID-2E2592AD-36B5-4AF1-933D-AE1B9C0FE970__GUID-FA0A0D34-B9EF-43A5-91DB-40ED64D4EE1F" style="box-sizing: border-box;"><div class="table-responsive" style="box-sizing: border-box; min-height: 0.01%; overflow-x: auto;"><table border="1" cellpadding="4" cellspacing="0" class="Formal" frame="hsides" rules="rows" style="border-collapse: collapse; border-spacing: 0px; border: 2px solid rgb(236, 234, 229); color: #1a1816; font-size: 14px; font-stretch: normal; line-height: 16px; min-width: 420px; table-layout: fixed; width: 100%px;" summary="This table describes common Data Gateway
issues, and how to address them." title=""><thead style="box-sizing: border-box;"><tr align="left" style="box-sizing: border-box;" valign="top"><th align="left" id="d1600e2166" style="background: rgb(248, 247, 244); border: 2px solid rgb(236, 234, 229); box-sizing: border-box; font-stretch: normal; height: 38px; line-height: 16px; overflow-wrap: break-word; padding: 10px; text-align: left;" valign="bottom" width="30%">Issue reported</th><th align="left" id="d1600e2168" style="background: rgb(248, 247, 244); border: 2px solid rgb(236, 234, 229); box-sizing: border-box; font-stretch: normal; height: 38px; line-height: 16px; overflow-wrap: break-word; padding: 10px; text-align: left;" valign="bottom" width="70%">Do this</th></tr></thead><tbody style="box-sizing: border-box;"><tr align="left" style="box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1600e2172" style="background: rgb(255, 255, 255); border: 2px solid rgb(236, 234, 229); box-sizing: border-box; font-stretch: normal; line-height: 16px; overflow-wrap: break-word; padding: 10px;" valign="top" width="30%">All issues</td><td align="left" style="background: rgb(255, 255, 255); border: 2px solid rgb(236, 234, 229); box-sizing: border-box; font-stretch: normal; line-height: 16px; overflow-wrap: break-word; padding: 10px;" valign="top" width="70%"><p style="box-sizing: border-box; font-stretch: normal; line-height: 1.44; margin: 0px 0px 14px;">Check that you are on the correct version of Data Gateway that matches your version of <span style="box-sizing: border-box;">Oracle Analytics Cloud</span>.</p><p style="box-sizing: border-box; font-stretch: normal; line-height: 16px; margin: 14px 0px 0px;">To check the version of the Data Gateway agent, on a server deployment, refer to the <code class="codeph" style="background: inherit; border-radius: 4px; box-sizing: border-box; color: inherit; font-family: "Courier New", Courier, monospace; font-size: inherit; padding: 0px;">version</code> in the file <code class="codeph" style="background: inherit; border-radius: 4px; box-sizing: border-box; color: inherit; font-family: "Courier New", Courier, monospace; font-size: inherit; padding: 0px;"><installdirectory>/inventory/registry.xml</code>.</p></td></tr><tr align="left" style="box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1600e2192" style="background: rgb(255, 255, 255); border: 2px solid rgb(236, 234, 229); box-sizing: border-box; font-stretch: normal; line-height: 16px; overflow-wrap: break-word; padding: 10px;" valign="top" width="30%">Agent state change failed with error: Agent name or <span style="box-sizing: border-box;">Oracle Analytics Cloud</span> URL not specified or the Key pair not generated</td><td align="left" style="background: rgb(255, 255, 255); border: 2px solid rgb(236, 234, 229); box-sizing: border-box; font-stretch: normal; line-height: 16px; overflow-wrap: break-word; padding: 10px;" valign="top" width="70%">Click <span class="uicontrol bold" style="box-sizing: border-box; font-weight: bold;">Save</span>, then <span class="uicontrol bold" style="box-sizing: border-box; font-weight: bold;">Enable</span>. If the problem persists, restart the application. If necessary, check your network.</td></tr><tr align="left" style="box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1600e2206" style="background: rgb(255, 255, 255); border: 2px solid rgb(236, 234, 229); box-sizing: border-box; font-stretch: normal; line-height: 16px; overflow-wrap: break-word; padding: 10px;" valign="top" width="30%"><p style="box-sizing: border-box; font-stretch: normal; line-height: 1.44; margin: 0px;">Invalid <span style="box-sizing: border-box;">Oracle Analytics Cloud</span> URL (Data Gateway can't communicate with <span style="box-sizing: border-box;">Oracle Analytics Cloud</span>)</p></td><td align="left" style="background-attachment: initial; background-clip: initial; background-image: initial; background-origin: initial; background-position: initial; background-repeat: initial; background-size: initial; border: 2px solid rgb(236, 234, 229); box-sizing: border-box; font-stretch: normal; line-height: 16px; overflow-wrap: break-word; padding: 10px;" valign="top" width="70%"><ul id="GUID-2E2592AD-36B5-4AF1-933D-AE1B9C0FE970__UL_A4H_MPJ_Y3B" style="box-sizing: border-box; margin-bottom: 10px; margin-top: 0px;"><li style="background-color: white; box-sizing: border-box; margin-bottom: 0.5em; margin-top: 0.5em;">Check that you've enabled and configured Data Gateway in <span style="box-sizing: border-box;">Oracle Analytics Cloud</span> Console.</li><li style="background-color: white; box-sizing: border-box; margin-bottom: 0.5em; margin-top: 0.5em;">Make sure you can reach the <span style="box-sizing: border-box;">Oracle Analytics Cloud</span> URL from the environment where Data Gateway is running. For example, on Linux you might use a <code class="codeph" style="background: inherit; border-radius: 4px; box-sizing: border-box; color: inherit; font-family: "Courier New", Courier, monospace; font-size: inherit; padding: 0px;">traceroute</code> command, such as <code class="codeph" style="background: inherit; border-radius: 4px; box-sizing: border-box; color: inherit; font-family: "Courier New", Courier, monospace; font-size: inherit; padding: 0px;">sudo traceroute -T -p 443 <Fully qualified domain name of your <span style="box-sizing: border-box;">Oracle Analytics Cloud</span> instance></code>.</li><li style="background-color: white; box-sizing: border-box; margin-bottom: 0.5em; margin-top: 0.5em;">Make sure there's nothing else blocking communication through the firewall.</li><li style="box-sizing: border-box; margin-bottom: 0.5em; margin-top: 0.5em;"><span style="background-color: white;">If you're using a proxy:</span><div class="p" style="box-sizing: border-box; font-stretch: normal; line-height: 16px; margin: 14px 0px;"><ol id="GUID-2E2592AD-36B5-4AF1-933D-AE1B9C0FE970__OL_EWY_HYM_3JB" style="box-sizing: border-box; margin-bottom: 0px; margin-top: 0px;"><li style="background-color: white; box-sizing: border-box; margin-bottom: 0.5em; margin-top: 0.5em;">Stop the Data Gateway agent.</li><li style="box-sizing: border-box; margin-bottom: 0.5em; margin-top: 0.5em;"><span style="background-color: white;">On the machine where you've installed Data Gateway, configure the </span><span style="background-color: #fcff01;">Data Gateway properties</span><span style="background-color: white;">:</span><p style="background-color: white; box-sizing: border-box; font-stretch: normal; line-height: 1.44; margin: 0px 0px 0.5em;">In a server deployment, edit this file:</p><p style="background-color: white; box-sizing: border-box; font-stretch: normal; line-height: 16px; margin: 0px 0px 0.5em;"><code class="codeph" style="background: inherit; border-radius: 4px; box-sizing: border-box; color: inherit; font-family: "Courier New", Courier, monospace; font-size: inherit; padding: 0px;"><Installed location>/jetty/obiee_rdc_agent.properties</code></p><p style="background-color: white; box-sizing: border-box; font-stretch: normal; line-height: 16px; margin: 0px 0px 0.5em;">In a personal deployment, edit this file:</p><p style="background-color: white; box-sizing: border-box; font-stretch: normal; line-height: 16px; margin: 0px 0px 0.5em;"><code class="codeph" style="background: inherit; border-radius: 4px; box-sizing: border-box; color: inherit; font-family: "Courier New", Courier, monospace; font-size: inherit; padding: 0px;"><Installed location>\obiee_rdc_agent.properties</code></p></li><li style="background-color: white; box-sizing: border-box; margin-bottom: 0.5em; margin-top: 0.5em;">Update the following properties with the details of your internet proxy host:<ul id="GUID-2E2592AD-36B5-4AF1-933D-AE1B9C0FE970__d2791e123" style="box-sizing: border-box; list-style-type: disc; margin-bottom: 0px; margin-top: 0px;"><li style="box-sizing: border-box; margin-bottom: 0.5em; margin-top: 0.5em;">proxyUserName</li><li style="box-sizing: border-box; margin-bottom: 0.5em; margin-top: 0.5em;">proxyPassword</li><li style="box-sizing: border-box; margin-bottom: 0.5em; margin-top: 0.5em;">proxyHost (for example, www-proxy.us.oracle.com)</li><li style="box-sizing: border-box; margin-bottom: 0.5em; margin-top: 0.5em;">proxyPort (for example, 80)</li></ul></li><li style="background-color: white; box-sizing: border-box; margin-bottom: 0.5em; margin-top: 0.5em;">Start the Data Gateway agent.</li></ol></div></li></ul></td></tr><tr align="left" style="box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d1600e2276" style="background: rgb(255, 255, 255); border: 2px solid rgb(236, 234, 229); box-sizing: border-box; font-stretch: normal; line-height: 16px; overflow-wrap: break-word; padding: 10px;" valign="top" width="30%">Test fails in Console page <span class="wintitle" style="box-sizing: border-box;">Remote Data Connectivity</span></td><td align="left" style="background: rgb(255, 255, 255); border: 2px solid rgb(236, 234, 229); box-sizing: border-box; font-stretch: normal; line-height: 16px; overflow-wrap: break-word; padding: 10px;" valign="top" width="70%"><p style="box-sizing: border-box; font-stretch: normal; line-height: 1.44; margin: 0px 0px 14px;">If the test fails, this means that the Data Gateway agent can't authenticate. Possible reasons include:</p><ul id="GUID-2E2592AD-36B5-4AF1-933D-AE1B9C0FE970__UL_DN4_DV4_2MB" style="box-sizing: border-box; margin-bottom: 10px; margin-top: 0px;"><li style="box-sizing: border-box; margin-bottom: 0.5em; margin-top: 0.5em;">The agent key hasn't been copied to the <span class="uicontrol bold" style="box-sizing: border-box; font-weight: bold;">Remote Data Connectivity</span> page in <span style="box-sizing: border-box;">Oracle Analytics Cloud</span> Console.</li><li style="box-sizing: border-box; margin-bottom: 0.5em; margin-top: 0.5em;">The agent key has been regenerated in the agent, but the new key hasn't been copied to the <span class="uicontrol bold" style="box-sizing: border-box; font-weight: bold;">Remote Data Connectivity</span> page in <span style="box-sizing: border-box;">Oracle Analytics Cloud</span> Console.</li><li style="box-sizing: border-box; margin-bottom: 0.5em; margin-top: 0.5em;">There's no suitable network route from the agent to <span style="box-sizing: border-box;">Oracle Analytics Cloud</span>.</li></ul></td></tr></tbody></table></div></div></div></div></div></div><div><div class="sect3" style="box-sizing: border-box;"><h3 style="background-attachment: initial; background-clip: initial; background-image: initial; background-origin: initial; background-position: initial; background-repeat: initial; background-size: initial; box-sizing: border-box; color: inherit; font-family: inherit; font-size: 21px; font-weight: 400; line-height: 1.1; margin-bottom: 10px; margin-top: 10px; text-align: left;">Frequently Asked Questions about Data Gateway</h3><div style="box-sizing: border-box;"><br />Please check RDG Documentation on <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsds/connect-premise-data-sources.html#GUID-F6D0D5A5-E47F-4940-ADAB-B217D63934A9">Data Gateway Frequently Asked Questions </a>:<br /><ul style="text-align: left;"><li>What operating systems does Data Gateway support?</li><li>What is the Data Gateway Architecture?</li><li>What is the difference between Remote Data Connector and Data Gateway?</li><li>Where do I install Data gateway?</li><li>Can I deploy multiple Data Gateway agents?</li><li>How do I configure High Availability for Data Gateway?</li><li>Why is Data Gateway traffic egress only?</li><li>How does Data Gateway manage SSL certificates?</li><li>How do I size Data Gateway?</li><li>Where is Data Gateway running? Do I install it on a virtual machine (VM)?</li><li>Can I use Data Gateway and Remote Data Connector with my Oracle Analytics Cloud instance at the same time?</li><li>How is Data Gateway network traffic secured?</li><li>Can Data Gateway limit queries that affect performance or security?</li><ul><li><span style="color: #1a1816;">Data Gateway doesn't limit the query row size. The query row size limit is determined by the number of Oracle Compute Units (OCPUs) that your </span><span style="box-sizing: border-box; color: #1a1816;">Oracle Analytics Cloud</span><span style="color: #1a1816;"> service has.</span></li></ul><li>What is the timeout setting for Data Gateway?</li><ul><li><span style="color: #1a1816;">Data Gateway uses the same query timeout as </span><span style="box-sizing: border-box; color: #1a1816;">Oracle Analytics Cloud</span><span style="color: #1a1816;">. See </span><a href="https://docs.oracle.com/pls/topic/lookup?ctx=en/cloud/paas/analytics-cloud/acsds&id=ACOCI-GUID-7D6DB4EE-8DD5-44C5-9B6E-9FA847463A5F__TABLE3" style="box-sizing: border-box; color: #00688c; text-decoration-line: none;" target="_blank">Limits Querying Data (Data Visualization Projects, Classic Analyses and Dashboards)</a><span style="color: #1a1816;">.</span></li></ul></ul></div></div></div><div><br /></div><h3 style="text-align: left;"><span style="font-size: large; font-weight: normal;">Deployment of Remote Data Gateway </span></h3><div><br /></div><div>Read the below articles for the step-by-step instructions on the installation and deployment of remote data gateway (RDG) for Oracle Analytics Cloud:</div></div><div></div><blockquote><div></div></blockquote><blockquote style="text-align: left;"><a href="https://www.ateam-oracle.com/installing-oracle-analytics-cloud-remote-data-gateway" target="_blank">Installing Oracle Analytics Cloud Remote Data Gateway</a><br /><a href="https://www.ateam-oracle.com/preparing-linux-for-oracle-remote-data-gateway" target="_blank">Preparing Linux for Oracle Remote Data Gateway</a><br /><a href="https://www.ateam-oracle.com/deploying-oracle-analytics-cloud-remote-data-gateway-in-a-private-subnet" target="_blank">Deploying Oracle Analytics Cloud Remote Data Gateway in a Private Subnet</a><br /><a href="https://www.ateam-oracle.com/deploying-oracle-analytics-cloud-remote-data-gateway-in-a-public-subnet" target="_blank">Deploying Oracle Analytics Cloud Remote Data Gateway in a Public Subnet</a><br /><a href="https://www.ateam-oracle.com/deploying-oracle-analytics-cloud-remote-data-gateway-on-premise" target="_blank">Deploying Oracle Analytics Cloud Remote Data Gateway On Premise</a><br /><a href="https://www.ateam-oracle.com/deploying-oracle-analytics-cloud-remote-data-gateway-using-local-peering-gateways" target="_blank">Deploying Oracle Analytics Cloud Remote Data Gateway using Local Peering Gateways</a><br /><div><a href="https://www.ateam-oracle.com/deploying-oracle-analytics-cloud-remote-data-gateway-in-a-remote-private-subnet" target="_blank">Deploying Oracle Analytics Cloud Remote Data Gateway in a Remote Private Subnet </a></div><div><a href="https://www.ateam-oracle.com/completing-the-deployment-of-remote-data-gateway-for-oac" target="_blank">Completing the Deployment of Remote Data Gateway for Oracle Analytics Cloud</a></div></blockquote><blockquote><div><a href="https://www.ateam-oracle.com/completing-the-deployment-of-remote-data-gateway-for-oac" target="_blank"></a></div></blockquote><div><div><br /></div><div>If you have subscribed to <a href="https://support.oracle.com/knowledge/Oracle%20Database%20Products/1545533_1.html" target="_blank">My Oracle Support</a>, you can also check the below articles for more information:</div><div><div><ul><li><a href="https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=476913474372360&id=2590606.1&_adf.ctrl-state=17m9cv2jdq_53">NOTE:2590606.1</a> - OAC: How To Increase Logging For Remote Data Gateway Agent in OAC</li><li><a href="https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=476947185996725&id=2574387.1&_adf.ctrl-state=17m9cv2jdq_110">NOTE:2574387.1</a> - Guidance For Using Remote Data Gateway (RDG) on Environments Upgraded From Oracle Analytics Cloud 105.2 and Lower</li><li><a href="https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=477090719387386&parent=EXTERNAL_SEARCH&sourceId=PROBLEM&id=2631494.1&_afrWindowMode=0&_adf.ctrl-state=17m9cv2jdq_224" target="_blank">NOTE:2631494.1</a> - OAC: Test From Remote Data Gateway(RDG) Agent Config page fails with "Invalid OAC URL" Error</li><li><a href="https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=477334175211003&parent=EXTERNAL_SEARCH&sourceId=PROBLEM&id=2653783.1&_afrWindowMode=0&_adf.ctrl-state=17m9cv2jdq_314">NOTES:2653783.1</a> - OAC RDG 5.5 : RDG Agent Configuration With Proxy Authentication Errors Out While Connecting To OAC</li><li><a href="https://support.oracle.com/epmos/faces/SearchDocDisplay?_adf.ctrl-state=jhxrpf6hj_4&_afrLoop=105230105068046#SYMPTOM" target="_blank">NOTES:2815638.1</a> - All Dashboard Reports Using RPD Failed With Error: <span style="background-color: #fcff01; color: #800180;">Invalid Oracle URL specified</span></li></ul><div><br /></div></div><div><h3><span style="font-size: large;">References</span></h3><ol><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsds/connect-premise-data-sources.html#GUID-7D4A2A9F-1E6A-4F93-81D3-00A272398D5C" target="_blank">Troubleshooting Data Gateway</a></li><li><a href="https://www.ateam-oracle.com/installing-oracle-analytics-cloud-remote-data-gateway" target="_blank">Installing Oracle Analytics Cloud Remote Data Gateway</a></li><li><a href="https://www.ateam-oracle.com/completing-the-deployment-of-remote-data-gateway-for-oac" target="_blank">Completing the Deployment of Remote Data Gateway for Oracle Analytics Cloud</a></li><li><a href="https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=295515732978921&parent=EXTERNAL_SEARCH&sourceId=PROBLEM&id=2631494.1&_afrWindowMode=0&_adf.ctrl-state=ck81wl1nc_4" target="_blank">OAC: Test From Remote Data Gateway(RDG) Agent Config page fails with "Invalid OAC URL" Error (Doc ID 2631494.1)</a></li><li><a href="https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=295823506997651&parent=EXTERNAL_SEARCH&sourceId=PROBLEM&id=2653783.1&_afrWindowMode=0&_adf.ctrl-state=ck81wl1nc_53" target="_blank">OAC RDG 5.5 : RDG Agent Configuration With Proxy Authentication Errors Out While Connecting To OAC (Doc ID 2653783.1)</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/get-started-configuration.html" target="_blank">Configuring Oracle Analytics Cloud</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsds/connect-premise-data-sources.html#GUID-66508027-EE50-44F9-B0DE-A535923F0560" target="_blank">Configure and Register Data Gateway for Data Visualization</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acoci/manage-service-access-and-security.html#GUID-C13DE22F-5069-4704-B64E-2F6D28B8D027" target="_blank">Give Data Sources Access to Analytics Cloud Instances</a></li><li><a href="https://blogs.oracle.com/analytics/cache-management-in-oracle-analytics-cloud-54-onwards-v2" target="_blank">Cache Management in Oracle Analytics Cloud 5.4 Onwards</a></li><li><a href="https://www.ateam-oracle.com/guest-contributor?search_terms=OAC" target="_blank">Best Practices from Oracle Development's A‑Team</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsds/connect-premise-data-sources.html#GUID-7D4A2A9F-1E6A-4F93-81D3-00A272398D5C" target="_blank">Connect to On-premise Data Sources</a></li><li><a href="https://www.ateam-oracle.com/connecting-to-private-data-sources-using-oracle-analytics-cloud-private-access-channel" target="_blank">Connecting to Private Data Sources using Oracle Analytics Cloud Private Access Channel</a></li><ul><li><span style="background-color: #fcff01; color: #800180;">Private Access Channel</span> compliments and provides <span style="background-color: #fcff01; color: #800180;">an alternative to Remote Data Gateway</span> (RDG) for the private data sources it supports. Both PAC and RDG may be used within the same instance of OAC.</li></ul><li><a href="https://www.ateam-oracle.com/preparing-network-gateways-for-private-oracle-analytics-cloud-data-sources" target="_blank">Preparing Network Gateways for Private Oracle Analytics Cloud Data Sources</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acoci/manage-service-access-and-security.html#GUID-4DF3B518-2D7B-4C37-B4C8-3F35D68372F6" target="_blank">Connect to Private Data Sources Through a <span style="background-color: #fcff01; color: #800180;">Private Access Channel</span></a></li><li><a href="https://docs.oracle.com/en/middleware/bi/analytics-server/security-oas/managing-security-oracle-analytics-server.pdf" target="_blank">Oracle Analytics Managing Security for Oracle Analytics Server, 5.9.0</a> (pdf)</li><li><a href="https://blogs.oracle.com/analytics/troubleshooting-private-access-channel-connectivity-for-oracle-analytics-cloud" target="_blank">Troubleshooting <span style="background-color: #fcff01; color: #800180;">Private Access Channel</span> Connectivity for Oracle Analytics Cloud</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsds/supported-data-sources.html" target="_blank">Oracle Analytics Cloud <span style="background-color: #fcff01; color: #800180;">supported Data Sources</span></a></li><li><a href="https://www.ateam-oracle.com/post/connecting-to-oracle-analytics-cloud-private-endpoint-with-vpn-fastconnect" target="_blank">Connecting to Oracle Analytics Cloud Private Endpoint with VPN / FastConnect</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acoci/manage-service-access-and-security.html#GUID-3DB25824-4417-4981-9EEC-29C0C6FD3883" target="_blank">Manage Service Access and Security</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acoci/manage-service-access-and-security.html#GUID-19F1F4B0-3709-4243-BC00-0FD078F1E444" target="_blank"><span style="background-color: #fcff01; color: #800180;">Prerequisites</span> for a Private Access Channel</a> (PAC)</li></ol></div></div></div>Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com16tag:blogger.com,1999:blog-748094882401183761.post-24631544865127973212020-08-30T14:59:00.006-05:002020-12-03T09:56:48.363-06:00NTP—How to Check It Is Working?<div><a href="https://en.wikipedia.org/wiki/Network_Time_Protocol" target="_blank">Network Time Protocol</a> (NTP) synchronizes timekeeping among a set of distributed time servers and clients. This synchronization allows events to be correlated when system logs are created and other time-specific events occur. </div><div><br /></div><h2 style="text-align: left;">Clock Skew</h2><div><br /></div><a href="https://en.wikipedia.org/wiki/Clock_skew" target="_blank">Clock skew</a> is a phenomenon in computers in which the same sourced <a href="https://en.wikipedia.org/wiki/Clock_signal">clock signal</a> arrives at different components at different times. The instantaneous difference between the readings of any two clocks is called their skew.<div><br /></div><div>Causes of <a href="https://en.wikipedia.org/wiki/Clock_skew" target="_blank">Clock Skew</a> could include:</div><div><ul style="text-align: left;"><li><b>No running NTP services</b> </li><li><b>Not properly configured NTP services</b><sup>[1]</sup></li><li><b>NTP attack</b><sup>[2,7-9]</sup></li><ul><li>Some of which result in <b>shifting time on NTP clients</b></li><li>Another threat consideration is a <b>malicious insider</b>, who could modify system time in attempts to hide events or manipulate time sensitive transactions.</li></ul><li><b>Network is congested or lossy</b><sup>[3]</sup></li></ul></div><div><br /></div><h2 style="text-align: left;">NTP—How Does It Work?</h2><div><br /></div><div>NTP uses the <a href="https://en.wikipedia.org/wiki/User_Datagram_Protocol" target="_blank">User Datagram Protocol</a> (UDP) as its transport protocol. All NTP communication uses
<b>Coordinated Universal Time </b>(UTC). An NTP network usually receives its time from an authoritative time
source, such as a <b>radio clock</b> or an <b>atomic clock</b> attached to a <b>time server</b>. NTP distributes this time across
the network. </div><div><br /></div><div>NTP is extremely efficient; no more than one packet per minute is necessary to synchronize two
machines to within a millisecond of each other. </div><div><br /></div><h3 style="text-align: left;">Stratum</h3><div><br /></div><div>NTP uses the concept of a “stratum” to describe how many NTP “hops” away a machine is from an authoritative
time source. A “stratum 1” time server typically has an authoritative time source (such as a radio or atomic
clock, or a GPS time source) directly attached, a “stratum 2” time server receives its time via NTP from a
“stratum 1” time server, and so on. </div><div><br /></div><h2 style="text-align: left;">Was Your NTP Service Properly Configured?</h2><div><br /></div>Your web server’s system time can keep on slipping far into the future or past if <a href="https://en.wikipedia.org/wiki/Network_Time_Protocol">NTP</a> is not properly configured. Having accurate system time is critical for:<div><ul style="text-align: left;"><li><b>Application logic</b></li><li><b>Scheduled jobs </b></li><li><b>Logging</b></li><ul><li>If the system time is off, <b>log forensics</b> and <b>log correlation</b> of security events across systems becomes a nightmare</li></ul></ul><div>and this is especially true for virtual machine based deployments.</div><div><br /></div><div><h3 style="text-align: left;">How to Sync the Clock on VMs?</h3><br />If you use Red Hat Enterprise Linux, here are some existing knowledge base documents on how to sync the clock on VMs, such as:<br /><ul style="text-align: left;"><li><a href="https://access.redhat.com/solutions/27865" target="_blank">Best practices for accurate timekeeping for Red Hat Enterprise Linux running on Red Hat Virtualization</a> </li><li><a href="https://access.redhat.com/solutions/64868" target="_blank">How to troubleshoot NTP issues</a></li><li><a href="https://access.redhat.com/articles/1456843" target="_blank">Understanding Red Hat Enterprise Linux System Clocks And Time Protocol Implementations </a></li></ul><br /><h2 style="text-align: left;">How to check NTP is working?</h2><div><br /></div><div>You can use the below commands to check:</div><ul style="text-align: left;"><li><b>ntpq </b>— standard NTP query program</li><li><b>ntpstat </b>— show network time synchronisation status</li><li><b>timedatectl </b>— show or set info about ntp using systemd</li></ul></div><div><br /></div><h3 style="text-align: left;">ntpq</h3><div><div><div><br /></div><div>The ntpq utility program is used to monitor NTP daemon ntpd operations and determine performance. <br /><br />$ <b><span style="background-color: #fcff01; color: #800180;">ntpq</span></b></div><div><pre><span style="font-family: courier; font-size: x-small;">ntpq> <b><span style="background-color: #fcff01; color: #800180;">pe</span></b>
remote refid st t when poll reach delay offset jitter
=====================================================================
-isipc6.cairn.ne .GPS1. 1 u 18 64 377 65.59 2 -5.891 0.044
+saicpc-isiepc2. pogo.udel.edu 2 u 241 128 370 10.477 -0.117 0.067
+uclpc.cairn.net pogo.udel.edu 2 u 37 64 177 212.111 -0.551 0.187
<b style="background-color: #fcff01;">*</b>pogo.udel.edu .GPS1. 1 u 95 128 377 0.607 </span><span style="font-family: courier; font-size: x-small;">0.123<span> 0.027</span></span></pre></div></div><div><br /></div><div><ul style="text-align: left;"><li><span style="background-color: #fcff01;">*</span></li><ul><li>The <a href="https://en.wikipedia.org/wiki/Tattletale" target="_blank">tattletale</a> symbol at the left margin displays the <b style="background-color: #fcff01;">synchronization status</b> of each peer. The <b>currently selected peer </b>is marked <b>*</b>, while additional peers designated acceptable for synchronization, but not currently selected, are marked +. </li><li>Peers marked <b>*</b> and <b>+</b> are included in the <b>weighted average computation</b> to set the local clock; the data produced by peers marked with other symbols are discarded. See <a href="https://linux.die.net/man/8/ntpq" target="_blank">ntpq</a> for the meaning of these symbols.</li></ul><li><b>remote</b></li><ul><li>Correspond to the server and peer entries listed in the configuration file; however, the DNS names might not agree if the names listed are not the canonical DNS names. </li></ul><li><b>refid</b></li><ul><li>Shows the current source of synchronization</li></ul><li><b>st</b></li><ul><li>Reveals the stratum</li></ul><li><tt><span style="font-family: inherit;"><b>t</b></span></tt></li><ul><li>The type (<tt>u</tt> = unicast, <tt>m</tt> = multicast, <tt>l</tt> = local, <tt>-</tt> = don't know)</li></ul><li><b>when </b>(in secs)</li><ul><li>Shows the time since the peer was last heard in seconds</li></ul><li><b>poll </b>(in secs)</li><ul><li>The poll interval </li></ul><li><b>reach</b></li><ul><li>Shows the status of the reachability register (see <a href="https://tools.ietf.org/html/rfc1305" target="_blank">RFC-1305</a>) in octal. </li></ul><li><b>delay</b> (in ms)</li><ul><li>Show the latest round-trip delay</li></ul><li><b>offset </b>(in ms)</li><ul><li>Show the latest offset</li><ul><li>Offset generally refers to the difference in time between an external timing reference and time on a local machine. </li><li>The greater the offset, the more inaccurate the timing source is. Synchronized NTP servers will generally have a low offset. </li></ul></ul><li><b>jitter </b>(in ms)</li><ul><li>Show the latest jitter (or estimated error) in milliseconds</li><ul><li>The jitter associated with a timing reference indicates the <b>magnitude of variance</b>, or <b>dispersion</b>, of the signal. Different timing references have different amounts of jitter. The more accurate a timing reference, the lower the jitter value. </li><li>Note that in NTP Version 4 what used to be the <b>dispersion </b>column has been replaced by the <b>jitter </b>column.</li></ul></ul></ul></div><div>To avoid possible distractions due to <b>name resolution problems</b>, run the <tt>ntpq</tt> program using the <tt><b><span style="background-color: #fcff01; color: #800180;">-n</span></b></tt> switch.</div><ul style="text-align: left;"><li><b>-n</b></li><ul><li>Output all host addresses in dotted-quad numeric format rather than converting to the canonical host names.</li></ul></ul><div><div><br /></div><div><div># <b><span style="background-color: #fcff01; color: #800180;">ntpq -np</span></b></div><div><span style="font-family: courier; font-size: x-small;"> remote refid st t when poll reach delay offset jitter</span></div><div><span style="font-family: courier; font-size: x-small;">==============================================================================</span></div><div><span style="font-family: courier; font-size: x-small;">*xxx.254.169.yyy 192.168.0.151 2 u 141 1024 377 0.545 0.066 0.131</span></div></div><div><br /></div><div><br /></div><h3 style="text-align: left;">ntpstat</h3><div><br /></div><div><div><a href="https://linux.die.net/man/8/ntpstat" target="_blank">ntpstat</a> is a script which prints a brief summary of the system clock's synchronization status when the <a href="https://en.wikipedia.org/wiki/Ntpd" target="_blank">ntpd</a> or <a href="https://opensource.com/article/18/12/manage-ntp-chrony" target="_blank">chronyd</a> daemon is running.</div><div><br /></div><div># <b><span style="background-color: #fcff01; color: #800180;">ntpstat</span></b></div><div><span style="font-family: courier; font-size: x-small;">synchronised to NTP server (xxx.254.169.yyy) at stratum 3</span></div><div><span style="font-family: courier; font-size: x-small;"> time correct to within 56 ms</span></div><div><span style="font-family: courier; font-size: x-small;"> polling server every 1024 s</span></div></div><div><br /></div><div><div># <b><span style="background-color: #fcff01; color: #800180;">echo $?</span></b></div><div><span style="font-family: courier; font-size: x-small;">0</span></div></div><div><br /></div>You can also use the <a href="https://bash.cyberciti.biz/guide/The_exit_status_of_a_command">exit status</a> (return values) to verify its operations from a shell script or command line itself. If exit status is<br /><ul style="text-align: left;"><li>0 – Clock is synchronized</li><li>1 – Clock is not synchronized</li><li>2 – If clock state is indefinite or questionable, for example if ntpd is not contactable</li></ul><div><br /></div><h4 style="text-align: left;">How "time correct to within 56 ms" was calculated?</h4><div><br /></div><div>The ntp query outputs from <a href="https://en.wikipedia.org/wiki/Ntpd" target="_blank">ntpd</a> and <a href="https://opensource.com/article/18/12/manage-ntp-chrony" target="_blank">chronyd</a> are different. The below discussion is based on <a href="https://en.wikipedia.org/wiki/Ntpd" target="_blank">ntpd</a>. </div><div><p style="font-family: calibri; font-size: 11pt; margin: 0in;"><br /></p><p style="margin: 0in;"><span style="font-family: courier; font-size: x-small;"> distance=$(echo "$delay $disp" |
awk '{ printf "%.3f", $1 / 2.0 + $2 }')</span></p><p style="margin: 0in;"><span style="font-family: courier; font-size: x-small;"> if [ -n "$distance" ]; then</span></p><p style="margin: 0in;"></p><p style="margin: 0in;"><span style="font-family: courier; font-size: x-small;"> printf " time correct to within %.0f ms" "$distance"</span></p><p style="font-family: calibri; font-size: 11pt; margin: 0in;"><br /></p><p style="font-family: calibri; font-size: 11pt; margin: 0in;">Therefore, distance = (delay / 2 + dispersion) </p></div></div></div></div><blockquote style="border: none; margin: 0px 0px 0px 40px; padding: 0px; text-align: left;"><div><div><div><div><p style="margin: 0in;"><span style="font-family: courier; font-size: x-small;">delay = 0.649</span></p></div></div></div></div><div><p style="margin: 0in;"><span style="font-family: courier; font-size: x-small;">dispersion = 55.480</span></p></div></blockquote><span style="font-family: Calibri; font-size: 11pt;">and "time correct to within </span><b style="font-family: calibri; font-size: 11pt;">56 </b><span style="font-family: Calibri; font-size: 11pt;">ms" was printed</span><br /><div><div><p style="font-family: calibri; font-size: 11pt; margin: 0in;"><br /></p><h4 style="font-family: calibri; font-size: 11pt; margin: 0in; text-align: left;">Raw Data</h4><p style="font-family: calibri; font-size: 11pt; margin: 0in;"><br /></p><p style="margin: 0in;"><span style="font-family: Calibri;"><span style="font-size: 14.6667px;"># <b><span style="background-color: #fcff01; color: #800180;">ntpq -c rv</span></b></span></span></p><p style="margin: 0in;"><span style="font-family: courier; font-size: x-small;">associd=0 status=0615 leap_none, sync_ntp, 1 event, clock_sync,</span></p><p style="margin: 0in;"><span style="font-family: courier; font-size: x-small;">version="ntpd 4.2.6p5@1.2349-o Tue Jun 23 15:14:56 UTC 2020 (1)",</span></p><p style="margin: 0in;"><span style="font-family: courier; font-size: x-small;">processor="x86_64", system="Linux/4.14.35-1902.10.8.el7uek.x86_64",</span></p><p style="margin: 0in;"><span style="font-family: courier; font-size: x-small;">leap=00, stratum=3, precision=-24, <b>rootdelay</b>=0.649, <b>rootdisp</b>=55.480,</span></p><p style="margin: 0in;"><span style="font-family: courier; font-size: x-small;">refid=xxx.254.169.yyy,</span></p><p style="margin: 0in;"><span style="font-family: courier; font-size: x-small;">reftime=e2f66690.7a8a26cd Sun, Aug 30 2020 17:55:28.478,</span></p><p style="margin: 0in;"><span style="font-family: courier; font-size: x-small;">clock=e2f66814.1623cd2d Sun, Aug 30 2020 18:01:56.086, peer=35146,</span></p><p style="margin: 0in;"><span style="font-family: courier; font-size: x-small;">tc=10, mintc=3, offset=-0.116, frequency=13.462, sys_jitter=0.000,</span></p><p style="margin: 0in;"><span style="font-family: courier; font-size: x-small;">clk_jitter=0.057, clk_wander=0.009</span></p><p style="margin: 0in;"><span style="font-family: Calibri;"><span style="font-size: 14.6667px;"><br /></span></span></p><p style="margin: 0in;"><span style="font-family: Calibri;"><span style="font-size: 14.6667px;"># <b><span style="background-color: #fcff01; color: #800180;">ntpstat</span></b></span></span></p><p style="margin: 0in;"><span style="font-family: courier; font-size: x-small;">synchronised to NTP server (xxx.254.169.yyy) at stratum 3</span></p><p style="margin: 0in;"><span style="font-family: courier; font-size: x-small;"> time correct to within <b>56 </b>ms</span></p><p style="margin: 0in;"><span style="font-family: courier; font-size: x-small;"> polling server every 1024 s</span></p></div><div><br /></div><h3 style="text-align: left;">timedatectl </h3><div><span face="" style="background-color: white; color: #212529; font-size: 14px;"><br /></span></div>If you are using <a href="https://www.blogger.com/#">systemd</a> based system, <a href="https://www.blogger.com/#">timedatectl</a> may be used to query and change the system clock and its settings.<br /><br />Run the following command to check the service status:<div><span face="" style="background-color: white; color: #212529; font-size: 14px;"><br /></span></div><div><div># <b style="background-color: #fcff01;"><span style="color: #800180;">timedatectl status</span></b></div><div><span style="font-family: courier; font-size: x-small;"> Local time: Sun 2020-08-30 17:12:19 UTC</span></div><div><span style="font-family: courier; font-size: x-small;"> Universal time: Sun 2020-08-30 17:12:19 UTC</span></div><div><span style="font-family: courier; font-size: x-small;"> RTC time: Sun 2020-08-30 17:12:20</span></div><div><span style="font-family: courier; font-size: x-small;"> Time zone: UTC (UTC, +0000)</span></div><div><span style="font-family: courier; font-size: x-small;"> NTP enabled: yes</span></div><div><span style="font-family: courier; font-size: x-small;">NTP synchronized: yes</span></div><div><span style="font-family: courier; font-size: x-small;"> RTC in local TZ: no</span></div><div><span style="font-family: courier; font-size: x-small;"> DST active: n/a</span></div></div><div><br /></div><div><div><h2 style="text-align: left;">How can I see the Time Difference between Client and Server?</h2><div class="ANSWER" style="break-before: avoid;"><br /></div><div class="ANSWER" style="break-before: avoid;"><span style="font-family: inherit;">Normally <a href="ntpd" target="_blank">ntpd</a> maintains an estimate of the time offset. To inspect these offsets, you can use the following commands:<sup>[5]</sup></span><p style="background-color: white;"></p><ol><li><span style="background-color: #fcff01; color: #800180;"><b>ntpq -np</b></span> will display the offsets for each reachable server in milliseconds</li><li><b><span style="background-color: #fcff01; color: #800180;">ntpdc -c loopinfo</span></b> will display the combined offset in seconds, as seen at the last poll. If supported, <b><span style="background-color: #fcff01; color: #800180;">ntpdc -c kerninfo</span></b> will display the current remaining correction, just as <b><span style="background-color: #fcff01; color: #800180;">ntptime</span></b> does.</li></ol>The first can be used to check what <b><span style="background-color: #fcff01; color: #800180;">ntpd</span></b> thinks the offset and jitter is currently, relative to the preferred/current server, the second can tell you something about the estimated offset/error all the way to the stratum 1 source. </div></div><div class="ANSWER" style="break-before: avoid;"><br /></div></div><h3 style="text-align: left;">References</h3><div><ol><li><a href="https://www.redhat.com/en/blog/avoiding-clock-drift-vms" target="_blank">Avoiding clock drift on VMs</a></li><li><a href="https://www.signalsciences.com/blog/system-clock-skewed-read-post-if-no-time/" target="_blank">System Clock Skewed? Read this Post, Especially if You Don’t Have Time</a></li><li><a href="http://doc.ntp.org/4.1.2/debug.htm" target="_blank">NTP Debugging Techniques</a></li><li><a href="https://kerneltalks.com/tools/all-you-need-to-know-about-sosreport/" target="_blank">All you need to know about sosreport tool</a></li><li><a href="http://www.ntp.org/ntpfaq/NTP-s-trouble.htm" target="_blank">Troubleshooting - ntp.org</a></li><li><a href="https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/6/html/deployment_guide/s1-checking_the_status_of_ntp" target="_blank">Check the status of NTP</a></li><li><a href="https://en.wikipedia.org/wiki/NTP_server_misuse_and_abuse" target="_blank">NTP server misuse and abuse</a></li><li><a href="https://www.imperva.com/learn/ddos/ntp-amplification/" target="_blank">NTP Amplification</a></li><li><a href="https://eprint.iacr.org/2015/1020.pdf" target="_blank">Attacking the Network Time Protocol</a></li><li><a href="https://www.cisco.com/c/en/us/td/docs/iosxr/ncs560/timing-and-sync/70x/b-network-sync-70x-ncs560/implementing_ntp.pdf" target="_blank">Implementing NTP</a></li><li><a href="https://access.redhat.com/solutions/401823" target="_blank">What does "ntpd -x" mean? Can I run NTP in slewmode?</a></li><li><a href="http://support.ntp.org/bin/view/Support/SelectingOffsiteNTPServers" target="_blank">Selecting Offsite NTP Servers</a></li><li><a href="https://www.cyberciti.biz/faq/linux-unix-bsd-is-ntp-client-working/" target="_blank">How to verify NTP is working Or not (Check Status of NTP)</a></li><li><a href="https://community.cisco.com/t5/other-data-center-subjects/how-to-restrict-ntp-mode-6-queries/td-p/3335720" target="_blank">Restrict NTP mode 6 queries</a> to avoid <a href="https://en.wikipedia.org/wiki/NTP_server_misuse_and_abuse" target="_blank">NTP amplification attacks</a></li></ol><div><br /></div></div></div>Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com8tag:blogger.com,1999:blog-748094882401183761.post-18057217775545772412020-08-23T15:43:00.009-05:002020-08-24T09:12:50.674-05:00Parsing WebLogic Access Log with Perl<h3 style="text-align: left;">Why Perl?</h3><div><br /></div><a href="https://en.wikipedia.org/wiki/Perl" target="_blank">Perl</a> is a general-purpose programming language originally developed for text manipulation and now used for a wide range of tasks including system administration, web development, network programming, GUI development, and more.<div><div><br /></div>Perl is easy, nearly unlimited, mostly fast, and kind of ugly. However, its power and quickness of coding can also be achieved with the combination of other tools:<div><div><ul style="text-align: left;"><li><i>shell </i>or <i>awk </i>programming with</li><ul><li><i>grep</i>, <i>cut</i>, <i>sort</i>, and <i>sed</i></li></ul></ul><div style="text-align: left;"><br /></div><h3 style="text-align: left;">Access Log in WebLogic</h3></div><br />By default, <a href="https://www.oracle.com/middleware/technologies/weblogic.html" target="_blank">WebLogic Server</a> (WLS) keeps a log of all HTTP transactions in a text file. The file is named <a href="https://docs.oracle.com/cd/E24329_01/web.1211/e24432/web_server.htm" target="_blank">access.log</a> and is located in the </div><blockquote><div>$DOMAIN_HOME/servers/Xxx/logs </div></blockquote><div>directory.<br /><br />The log provides true timing information from WebLogic, in terms of how long each individual application request takes. This timing information can be important in troubleshooting a slow system.<br /><br />For more details, read [2] or other more updated information at the Oracle official site.<br /><div><br /></div><h3 style="text-align: left;">Case Study</h3><div><br /></div><div>In this article, we will use the below sample access log entry for the illustration:</div><div><br /></div><div><div><span style="font-size: x-small;"><b>2020-08-23 15:54:02 0.031 479 GET /xx-contentyyyyyyy/api/v1/instances/bootstrap/artifacts/namespaces/content:catalog/attributes/system/skins/activetheme 404 "4cb1bd49-1deb-4b6f-84c5-1153f22e3739-0000000c" "1.4cb1bd49-1deb-4b6f-84c5-1153f22e3739-0000000c;kXKwo3hCQtRLGmjE0ZJOoOTLkKPOoLRKlSODoITT_G" - -</b></span></div></div><div><br /></div><div><br /></div><div>Notice that the above fields are separated by <b>horizontal tab</b> (i.e., <b>ht</b>), not spaces.</div><div><br /></div><div><div><span style="font-family: courier; font-size: x-small;">0000000 2 0 2 0 - 0 8 - 2 3 <b>ht </b>1 5 : 5 4</span></div><div><span style="font-family: courier; font-size: x-small;">0000020 : 0 2 <b>ht </b>0 . 0 3 1 <b>ht </b>4 7 9 <b>ht </b>G E</span></div><div><span style="font-family: courier; font-size: x-small;">0000040 T <b>ht </b>/ b i - c o n t e n t s t o</span></div><div><span style="font-family: courier; font-size: x-small;">0000060 r a g e / a p i / v 1 / i n s t</span></div><div><span style="font-family: courier; font-size: x-small;">0000100 a n c e s / b o o t s t r a p /</span></div><div><span style="font-family: courier; font-size: x-small;">0000120 a r t i f a c t s / n a m e s p</span></div><div><span style="font-family: courier; font-size: x-small;">0000140 a c e s / c o n t e n t : c a t</span></div><div><span style="font-family: courier; font-size: x-small;">0000160 a l o g / a t t r i b u t e s /</span></div><div><span style="font-family: courier; font-size: x-small;">0000200 s y s t e m / s k i n s / a c t</span></div><div><span style="font-family: courier; font-size: x-small;">0000220 i v e t h e m e <b>ht </b>4 0 4 <b>ht </b>" 4 c</span></div><div><span style="font-family: courier; font-size: x-small;">0000240 b 1 b d 4 9 - 1 d e b - 4 b 6 f</span></div><div><span style="font-family: courier; font-size: x-small;">0000260 - 8 4 c 5 - 1 1 5 3 f 2 2 e 3 7</span></div><div><span style="font-family: courier; font-size: x-small;">0000300 3 9 - 0 0 0 0 0 0 0 c " <b>ht </b> " 1 .</span></div><div><span style="font-family: courier; font-size: x-small;">0000320 4 c b 1 b d 4 9 - 1 d e b - 4 b</span></div><div><span style="font-family: courier; font-size: x-small;">0000340 6 f - 8 4 c 5 - 1 1 5 3 f 2 2 e</span></div><div><span style="font-family: courier; font-size: x-small;">0000360 3 7 3 9 - 0 0 0 0 0 0 0 c ; k X</span></div><div><span style="font-family: courier; font-size: x-small;">0000400 K w o 3 h C Q t R L G m j E 0 Z</span></div><div><span style="font-family: courier; font-size: x-small;">0000420 J O o O T L k K P O o L R K l S</span></div><div><span style="font-family: courier; font-size: x-small;">0000440 O D o I T T _ G " <b>ht </b>- <b>ht </b>- nl </span></div></div><div><br /></div><h3 style="text-align: left;">Awk</h3><div><br /></div><a href="https://learning.oreilly.com/library/view/effective-awk-programming/9781491904930/" target="_blank">Awk</a> is a pattern scanning and processing language, which is good for purposes of extracting or transforming text, such as producing formatted reports. Read [4] for more details.<div><br /></div><div>For well-formatted access.log in WLS, <a href="https://learning.oreilly.com/library/view/effective-awk-programming/9781491904930/" target="_blank">awk</a> can be handy for extracting fields such as:</div><ul style="text-align: left;"><li><b>cs-method</b> — The request method, for example GET or POST. This field has type <name>, as defined in the W3C specification.</li><li><b>cs-uri</b> — The full requested URI. This field has type <uri>, as defined in the W3C specification.</li><li><b>sc-status</b> — Status code of the response, for example (404) indicating a "File not found" status. This field has type <integer>, as defined in the W3C specification.</li></ul><div><br /></div><div> bash-4.2$ <b style="background-color: #fcff01;">awk '{ print $5, $6, $7 }' sample.log | grep "\s404" | sort -r | uniq -c</b></div><div><span style="font-family: courier; font-size: x-small;"> 1 GET /</span><span style="font-size: x-small;">xx-contentyyyyyyy</span><span style="font-family: courier; font-size: x-small;">/api/v1/instances/bootstrap/artifacts/namespaces/content:catalog/attributes/users/18446744073709551615 404</span></div><div><span style="font-family: courier; font-size: x-small;"> 1 GET /</span><span style="font-size: x-small;">xx-contentyyyyyyy</span><span style="font-family: courier; font-size: x-small;">/api/v1/instances/bootstrap/artifacts/namespaces/content:catalog/attributes/system/skins/activetheme 404</span></div><div><span style="font-family: courier; font-size: x-small;"> 1 GET /</span><span style="font-size: x-small;">xx-contentyyyyyyy</span><span style="font-family: courier; font-size: x-small;">/api/v1/instances/bootstrap/artifacts/namespaces/content:catalog/attributes/maintenancemode 404</span></div><div><br /></div><div><br /></div><div><h3 style="text-align: left;">Perl</h3><div><br /></div><a href="https://en.wikipedia.org/wiki/Perl" target="_blank">Perl</a> is a powerful programming language due to its unsurpassed <a href="https://en.wikipedia.org/wiki/Regular_expression">regular expression</a> and <a href="https://en.wikipedia.org/wiki/String_(computing)">string</a> <a href="https://en.wikipedia.org/wiki/Parsing">parsing</a> abilities. In Perl, you can use patterns to locate the parts of strings that you want to change with its “<a href="https://perldoc.perl.org/perlrequick.html#Search-and-replace" target="_blank">search and replace</a>” .</div><div><br /></div>Search and replace is performed using <a href="https://perldoc.perl.org/functions/s.html">s/regex/replacement/modifiers</a>. The replacement is a Perl double-quoted string that replaces in the string whatever is matched with the regex . If there is a match, <a href="https://perldoc.perl.org/functions/s.html">s///</a> returns the number of substitutions made; otherwise it returns false.<div><br /></div><div><div><br /></div><div><div>bash-4.2$ <b style="background-color: #fcff01;">perl -n -p -e 's/^[^A-Z]*([A-Z]+)\s([^\"]*)\s(\".*)/$1 $2/g' sample.log | grep "\s404" | sort -r | uniq -c</b></div><div><br /></div><div><span style="font-family: courier; font-size: x-small;"> 1 GET /</span><span style="font-size: x-small;">xx-contentyyyyyyy</span><span style="font-family: courier; font-size: x-small;">/api/v1/instances/bootstrap/artifacts/namespaces/content:catalog/attributes/users/18446744073709551615 404</span></div><div><span style="font-family: courier; font-size: x-small;"> 1 GET /</span><span style="font-size: x-small;">xx-contentyyyyyyy</span><span style="font-family: courier; font-size: x-small;">/api/v1/instances/bootstrap/artifacts/namespaces/content:catalog/attributes/system/skins/activetheme 404</span></div><div><span style="font-family: courier; font-size: x-small;"> 1 GET /</span><span style="font-size: x-small;">xx-contentyyyyyyy</span><span style="font-family: courier; font-size: x-small;">/api/v1/instances/bootstrap/artifacts/namespaces/content:catalog/attributes/maintenancemode 404</span></div></div></div><div><br /></div><div><br /></div><div>Note that the above Perl example is not the optimal command for the designed purpose. But, we just try to demonstrate as many Perl's features as possible in one example. </div><div><br /></div><div>In the above example, our substitution operator is:</div><div><blockquote><b style="background-color: #fcff01;">s/</b><b>^[^A-Z]*([A-Z]+)\s([^\"]*)\s(\".*)</b><b style="background-color: #fcff01;">/</b><b>$1 $2</b><b style="background-color: #fcff01;">/</b><b>g</b></blockquote></div><div>or</div><div></div><blockquote><div><b>regex</b>: "<span><span style="color: red;">^[^A-Z]*</span><span style="color: #ffa400;"><b>([A-Z]+)</b></span><span style="color: #ff00fe;"><b>\s</b></span><span style="color: #2b00fe;"><b><span>([^\"]*</span>)</b></span><span style="color: #ff00fe;"><b>\s</b></span>(\".*)</span>"</div><div><b>replacement</b>: "$1 $2"</div><div><b>modifiers</b>: "g"</div></blockquote><p>where</p><p style="text-align: left;"></p><ul style="text-align: left;"><li><b>regex</b></li><ul><li><span><span style="color: red;">^[^A-Z]*</span> matches </span><b style="font-size: x-small;">2020-08-23 15:54:02 0.031 479 </b></li><li>The first <a href="https://www.regular-expressions.info/refcapture.html" target="_blank">capturing group</a> <b style="color: #ffa400;">([A-Z]+)</b> or <b>$1</b> match <b style="font-size: x-small;">GET /xx-contentyyyyyyy/api/v1/instances/bootstrap/artifacts/namespaces/content:catalog/attributes/system/skins/activetheme</b></li><li>The second capturing group <span><b style="color: #2b00fe;"><span>([^\"]*</span>)</b> </span>or <b>$2</b> matches <b style="font-size: x-small;">404</b></li><li>Note that we have discarded the third capturing group or <b>$3</b></li><li><b><b style="color: #ff00fe;">\s</b> </b>matches a <a href="https://perldoc.perl.org/perlrecharclass.html#Backslash-sequences" target="_blank">whitespace character</a> (i.e., <b>ht</b>)</li></ul><li><b>replacement</b></li><ul><li>The whole line was changed to "<span>$1 $2" or</span></li><ul><li><span><b style="font-size: x-small;">GET /xx-contentyyyyyyy/api/v1/instances/bootstrap/artifacts/namespaces/content:catalog/attributes/system/skins/activetheme </b></span><b style="font-size: x-small;">404</b></li></ul></ul><li><b>modifiers</b></li><ul><li>The global modifier <b>/g</b> allows the matching operator to match within a string as many times as possible. In our example, it is not needed. But, for illustration only.</li></ul></ul><p></p><div style="text-align: left;"></div><div style="text-align: left;">You can read this <a href="http://voyager.deanza.fhda.edu/~perry/cis331.html" target="_blank">Perl script example</a> to learn more of its features.</div><div style="text-align: left;"><br /></div><h3 style="text-align: left;">Acknowledgement</h3><div style="text-align: left;"><br /></div><div style="text-align: left;">This author would like thank his co-worker <i>Mohan Tadepalli</i> for providing Perl examples and inspiring me to write this article.</div><div style="text-align: left;"><br /></div><h3 style="text-align: left;">References</h3><div><ol style="text-align: left;"><li><a href="https://learning.oreilly.com/library/view/learning-perl-7th/9781491954317/ch01.html#llama-introduction-2-1" target="_blank">Learning Perl, 7th Edition</a></li><li><a href="https://docs.oracle.com/cd/E40518_01/server.761/es_admin/src/tadm_logging_access_log.html" target="_blank">Customizing the HTTP access log</a></li><li><a href="https://docs.oracle.com/cd/E24329_01/web.1211/e24432/web_server.htm#CNFGD204" target="_blank">Setting Up HTTP Access Logs</a> (WebLogic)</li><li><a href="https://learning.oreilly.com/library/view/effective-awk-programming/9781491904930/" target="_blank">Effective awk Programming, 4th Edition</a></li></ol></div></div></div>Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com7tag:blogger.com,1999:blog-748094882401183761.post-24629726349540678762020-08-13T16:59:00.006-05:002021-05-17T10:11:03.527-05:008 Flavors of OutOfMemoryErrorThere are total eight <a href="https://bloggceasy.files.wordpress.com/2015/05/outofmemoryerror2.pdf" target="_blank">different flavors</a> of java.lang.OutOfMemoryError ordered by roughly the frequency of occurrences in my own experience:<br /><ol style="text-align: left;"><li><a href="https://xmlandmore.blogspot.com/2012/01/understanding-garbage-collection.html" target="_blank">Java heap space</a></li><li><a href="https://xmlandmore.blogspot.com/2012/03/case-study-of-javalangoutofmemoryerror.html" target="_blank">GC Overhead limit exceeded</a></li><li><a href="https://xmlandmore.blogspot.com/2013/03/hotspotjavalangoutofmemoryerror-permgen.html" target="_blank">Permgen space</a></li><li><a href="https://xmlandmore.blogspot.com/2014/08/hotspot-tuning-and-monitoring-metaspace.html" target="_blank">Metaspace</a></li><li><a href="https://plumbr.io/outofmemoryerror/kill-process-or-sacrifice-child" target="_blank">Kill process or sacrifice child</a></li><li>Requested <a href="https://xmlandmore.blogspot.com/2014/02/javalangclasscastexception-i-cannot-be.html" target="_blank">array</a> size exceeds VM limit</li><li>Unable to create new <a href="https://xmlandmore.blogspot.com/2014/09/jdk-8-thread-stack-size-tuning.html" target="_blank">native thread</a></li><li><a href="https://www.javamadesoeasy.com/2017/02/outofmemoryerror-reason.html" target="_blank">reason stack_trace_with_native_method</a></li></ol><div><span style="background-color: #fcff01; color: #800180;">New Added (05/17/2021)</span></div><div><ul style="text-align: left;"><li><a href="https://docs.oracle.com/javase/8/docs/technotes/guides/troubleshoot/memleaks002.html" target="_blank">request <size> bytes for <reason>. Out of swap space</a></li><li><a href="https://docs.oracle.com/javase/8/docs/technotes/guides/troubleshoot/memleaks002.html" target="_blank">Compressed class space</a></li></ul></div><div>In the past, I have authored multiple articles on how to debug and resolve such OutOfMemory (OOM) issues. Here are a list of them:</div><ol style="text-align: left;"><li><a href="https://xmlandmore.blogspot.com/2012/01/understanding-garbage-collection.html" target="_blank">Understanding Garbage Collection</a> (HotSpot)</li><li><a href="https://xmlandmore.blogspot.com/2011/05/diagnosing-javalangoutofmemory.html" target="_blank">Diagnosing Java.lang.OutOfMemoryError</a> (Memory Analyzer)</li><li><a href="https://xmlandmore.blogspot.com/2012/03/understanding-garbage-collector-output.html" target="_blank">Understanding Garbage Collector Output of Hotspot VM</a> (Hotspot)</li><li><a href="https://xmlandmore.blogspot.com/2012/03/case-study-of-javalangoutofmemoryerror.html" target="_blank">A Case Study of java.lang.OutOfMemoryError: GC overhead limit exceeded</a> (HotSpot)</li><li><a href="https://xmlandmore.blogspot.com/2012/08/how-to-see-long-command-line-of-running.html" target="_blank">How to See a Long Command Line of a Running Process on HotSpot VM</a> (HotSpot)</li><ul><li>-XX:+HeapDumpOnOutOfMemoryError</li></ul><li><a href="https://xmlandmore.blogspot.com/2012/08/which-jvm.html" target="_blank">Which JVM?</a></li><ul><li>Ways to configure JVM options in JDeveloper / WebLogic Server / Eclipse</li></ul><li><a href="https://xmlandmore.blogspot.com/2012/10/hotspot-vm-performance-tips.html" target="_blank">HotSpot VM Performance Tuning Tips</a> (HotSpot)</li><li><a href="https://xmlandmore.blogspot.com/2013/03/hotspotjavalangoutofmemoryerror-permgen.html" target="_blank">HotSpot—java.lang.OutOfMemoryError: PermGen space</a> (HotSpot)</li><li><a href="https://xmlandmore.blogspot.com/2013/03/analyzing-performance-issue-caused-by.html" target="_blank">Analyzing the Performance Issue Caused by WebLogic Session Size Too Big</a> (HotSpot)</li><li><a href="https://xmlandmore.blogspot.com/2013/05/how-to-debug-native-outofmemory-in.html" target="_blank">How to Debug Native OutOfMemory in JRockit</a> (JRockit)</li><li><a href="https://xmlandmore.blogspot.com/2013/08/default-vm-options-of-jrockit.html" target="_blank">Default Values of JRockit's VM Options</a> (JRockit)</li><li><a href="https://xmlandmore.blogspot.com/2013/08/diagnosing-outofmemoryerror-or-memory_10.html" target="_blank">Diagnosing Heap Stress in HotSpot</a> (HotSpot)</li><li><a href="https://xmlandmore.blogspot.com/2014/01/jrockit-parallel-vs-concurrent.html" target="_blank">JRockit: Parallel vs Concurrent Collectors</a> (JRockit)</li><li><a href="https://xmlandmore.blogspot.com/2014/01/eclipse-mat-querying-heap-objects-using.html" target="_blank">Eclipse MAT: Querying Heap Objects Using OQL</a> (Memory Analyzer)</li><li><a href="https://xmlandmore.blogspot.com/2014/01/eclipse-mat-understand-incoming-and.html" target="_blank">Eclipse MAT: Understand Incoming and Outgoing References</a> (Memory Analyzer)</li><li><a href="https://xmlandmore.blogspot.com/2014/08/hotspot-tuning-and-monitoring-metaspace.html" target="_blank">HotSpot: Monitoring and Tuning Metaspace in JDK 8</a> (HotSpot)</li><li><a href="https://xmlandmore.blogspot.com/2014/09/jdk-8-thread-stack-size-tuning.html" target="_blank">JDK 8: Thread Stack Size Tuning</a> (HotSpot)</li><li><a href="https://xmlandmore.blogspot.com/2020/05/how-to-setup-standalone-memory-analyzer.html" target="_blank">How to Setup a Standalone Memory Analyzer for Windows 10</a> (Memory Analyzer)</li></ol>Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com22tag:blogger.com,1999:blog-748094882401183761.post-65869454134715904962020-08-02T21:04:00.001-05:002020-08-02T21:43:18.391-05:00How ABRT Avoid Storing Duplicated Crashes — DeduplicationProcesses crash for a multitude of reasons and it’s often difficult to understand the root causes that contribute to such crashes. The <a href="https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/6/html/deployment_guide/ch-abrt#tabl-abrt" target="_blank">Automatic Bug Reporting Tool</a>, commonly abbreviated as <i><b>ABRT</b></i>, could offer help for forensic investigation.<div><br /></div><div><h3 style="text-align: left;">ABRT</h3><br /><b><a href="https://www.blogger.com/blog/post/edit/748094882401183761/6586945413471590496#" target="_blank">ABRT</a> </b>consists of the abrtd daemon and a number of system services and utilities to process, analyze, and report detected problems. </div><div><br /></div><div>The daemon runs silently in the background most of the time, and springs into action when an application crashes or a kernel oops is detected. The daemon then collects the relevant problem data such as a core file if there is one, the crashing application's command-line parameters, and other data of forensic utility.</div><div><br /></div><h3 style="text-align: left;">Why ABRT?</h3><div><br /></div><div>Earlier when applications crashed, core dumps were generated, but not limited, which could quickly fill up the disk.</div><div><br /></div><div>A solution is to use <a href="https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/6/html/deployment_guide/ch-abrt" target="_blank">ABRT</a>. For example, it can</div><div><ul style="text-align: left;"><li>Rotate cores within a size limit by deleting the oldest<sup>[11]</sup></li><li>Avoid storing duplicate crashes by deduplication<sup>[9]</sup></li></ul><div><br /></div><h3 style="text-align: left;">Elements Collected by ABRT</h3><br /><div>In the below table, it shows a shortened list of elements collected by ABRT and their descriptions. For a full list see [4]. These elements are stored <b>in the form of files</b> in a single directory per detected problem (such a directory is called '<b>dump directory</b>').</div><div><div> </div><div><table style="background-color: white; border-bottom: 1px solid rgb(209, 209, 209); border-spacing: 0px; border-top: 1px solid rgb(209, 209, 209); color: #252525; font-family: "red hat text", overpass, helvetica, sans-serif; font-size: 11px; max-width: 100%;"><tbody style="box-sizing: border-box;"><tr style="border-radius: 0px; box-sizing: border-box;"><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right-color: initial; border-right-style: initial; border-right-width: 0px; border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;"><b>core_backtrace</b></td><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right: 1px solid rgb(209, 209, 209); border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">Machine readable backtrace with no private data</td></tr><tr style="border-radius: 0px; box-sizing: border-box;"><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right-color: initial; border-right-style: initial; border-right-width: 0px; border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">coredump</td><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right: 1px solid rgb(209, 209, 209); border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">Coredump of the crashing process</td></tr><tr style="border-radius: 0px; box-sizing: border-box;"><td style="background-attachment: initial; background-clip: initial; background-image: none; background-origin: initial; background-position: initial; background-repeat: initial; background-size: initial; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right-color: initial; border-right-style: initial; border-right-width: 0px; border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;"><b style="background-color: #fcff01;">count</b></td><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right: 1px solid rgb(209, 209, 209); border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">Number of times this problem occured</td></tr><tr style="border-radius: 0px; box-sizing: border-box;"><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right-color: initial; border-right-style: initial; border-right-width: 0px; border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">crash_function</td><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right: 1px solid rgb(209, 209, 209); border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">Function which crashed</td></tr><tr style="border-radius: 0px; box-sizing: border-box;"><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right-color: initial; border-right-style: initial; border-right-width: 0px; border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">dmesg</td><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right: 1px solid rgb(209, 209, 209); border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">Copy of dmesg</td></tr><tr style="border-radius: 0px; box-sizing: border-box;"><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right-color: initial; border-right-style: initial; border-right-width: 0px; border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">docker_inspect</td><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right: 1px solid rgb(209, 209, 209); border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">Output of docker inspect $(container_id)</td></tr><tr style="border-radius: 0px; box-sizing: border-box;"><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right-color: initial; border-right-style: initial; border-right-width: 0px; border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">dso_list</td><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right: 1px solid rgb(209, 209, 209); border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">List of dynamic libraries loaded at the time of crash</td></tr><tr style="border-radius: 0px; box-sizing: border-box;"><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right-color: initial; border-right-style: initial; border-right-width: 0px; border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">duphash</td><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right: 1px solid rgb(209, 209, 209); border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">Hash of the crash's backtrace</td></tr><tr style="border-radius: 0px; box-sizing: border-box;"><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right-color: initial; border-right-style: initial; border-right-width: 0px; border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">environ</td><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right: 1px solid rgb(209, 209, 209); border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">Dump of process environment variable along with their values</td></tr><tr style="border-radius: 0px; box-sizing: border-box;"><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right-color: initial; border-right-style: initial; border-right-width: 0px; border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">event_log</td><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right: 1px solid rgb(209, 209, 209); border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">Messages produced by ABRT tools during processing the detected problem</td></tr><tr style="border-radius: 0px; box-sizing: border-box;"><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right-color: initial; border-right-style: initial; border-right-width: 0px; border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">executable</td><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right: 1px solid rgb(209, 209, 209); border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">Executable path of the component which caused the problem.</td></tr><tr style="border-radius: 0px; box-sizing: border-box;"><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right-color: initial; border-right-style: initial; border-right-width: 0px; border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">global_pid</td><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right: 1px solid rgb(209, 209, 209); border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">Value of %P as passed by kernel to the core_pattern helper (see man core for more details)</td></tr><tr style="border-radius: 0px; box-sizing: border-box;"><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right-color: initial; border-right-style: initial; border-right-width: 0px; border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">hostname</td><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right: 1px solid rgb(209, 209, 209); border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">Hostname of the affected machine</td></tr><tr style="border-radius: 0px; box-sizing: border-box;"><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right-color: initial; border-right-style: initial; border-right-width: 0px; border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">kernel</td><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right: 1px solid rgb(209, 209, 209); border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">Kernel version string</td></tr><tr style="border-radius: 0px; box-sizing: border-box;"><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right-color: initial; border-right-style: initial; border-right-width: 0px; border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">kernel_log</td><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right: 1px solid rgb(209, 209, 209); border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">Results of vmcore crash analysis performed by retrace-server</td></tr><tr style="border-radius: 0px; box-sizing: border-box;"><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right-color: initial; border-right-style: initial; border-right-width: 0px; border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">kernel_tainted_long</td><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right: 1px solid rgb(209, 209, 209); border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">Tainted kernel description</td></tr><tr style="border-radius: 0px; box-sizing: border-box;"><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right-color: initial; border-right-style: initial; border-right-width: 0px; border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">kernel_tainted_short</td><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right: 1px solid rgb(209, 209, 209); border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">Kernel tainted flags (For more information about tainted flags see [1])</td></tr><tr style="border-radius: 0px; box-sizing: border-box;"><td style="background-attachment: initial; background-clip: initial; background-image: none; background-origin: initial; background-position: initial; background-repeat: initial; background-size: initial; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right-color: initial; border-right-style: initial; border-right-width: 0px; border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;"><b style="background-color: #fcff01;">last_occurrence</b></td><td style="background: none; border-bottom-color: initial; border-bottom-style: initial; border-bottom-width: 0px; border-image: initial; border-left: 1px solid rgb(209, 209, 209); border-right: 1px solid rgb(209, 209, 209); border-top: 1px solid rgb(237, 237, 237); box-sizing: border-box; padding: 0.5625rem 1.25rem;">Time of the last occurence (unixtime)</td></tr></tbody></table> <br /><h3 style="text-align: left;">Deduplication</h3><br />When ABRT catches new crash, it <b style="background-color: #fcff01;">compares it to the rest of the stored problems</b> to avoid storing duplicate crashes:<br /><ol style="text-align: left;"><li>It first checks if there is core_bactrace or uuid item in the <b>problem directory</b> it is processing</li><li>If there is a <b>core_backtrace</b></li><ul><li>It iterates over all other dump directories and <b style="background-color: #fcff01;">computes similarity</b> to their core backtraces (if any). If one of them is similar enough to be considered duplicate, event processing is stopped and only notify-dup event is fired.</li></ul><li>Or if there is an <b>uuid item</b> (and no core backtrace)</li><ul><li>Simple comparison of uuid hashes is used for duplicate detection.</li></ul></ol><div>You can read <a href="https://www.blogger.com/blog/post/edit/748094882401183761/6586945413471590496#" target="_blank">abrt-action-analyze-backtrace</a> for more information.<sup>[6]</sup></div></div><div><h3><br />count & last_occurrence</h3><div><br /></div><div>After the forensic investigation, you can use:</div><div><ul style="text-align: left;"><li><i><b>abrt-cli rm <path to the problem directory></b></i></li></ul></div><div>to remove the specified problem data directory with all its contents.</div><div><br /></div><div><div><font face="courier" size="2">[abrt]# <b>abrt-cli rm ccpp-2019-08-21-13:59:02-31929</b></font></div><div><font face="courier" size="2">PrivateReports is disabled. Run abrt-cli-root to see all problems detected by ABRT.</font></div><div><font face="courier" size="2">rm 'ccpp-2019-08-21-13:59:02-31929'</font></div></div><div><br /></div><div>However, note that ABRT performs a detection of duplicate problems by comparing new problems with all locally saved problems. </div><div><br /></div><div>For a repeating crash, ABRT requires you to act upon it only once. But, if you delete the crash dump of that problem, the next time this specific problem occurs, ABRT will treat it as a new crash: ABRT will alert you about it, prompt you to fill in a description, and report it. <b>To avoid having ABRT notifying you about a recurring problem, do not delete its problem data.<br /></b><div><br /></div></div></div><div>If you didn't remove a specific problem data directory, here is what would happen when ABRT catches a new crash :</div><div><ul style="text-align: left;"><li>ABRT <b>compares it to the rest of locally stored problems</b></li><li>If it's a new problem, a new problem directory will be created</li><li>Otherwise, ABRT will update the recurring problem by:</li><ul><li>Incrementing "<b>count</b>" by one</li><li>Updating "<b>last_occurrence</b>" with a new <a href="https://www.blogger.com/#">epoch</a></li></ul></ul></div><div><div><div><font face="courier" size="2">[ccpp-2019-08-21-13:59:02-31929]# <b>ls -lrt</b></font></div><div><font face="courier" size="2">total 868572</font></div><div><font face="courier" size="2">-rw-r-----. 1 abrt abrt 3 Aug 21 2019 uid</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 10 Aug 21 2019 time</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 32 Aug 21 2019 os_release</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 30 Aug 21 2019 kernel</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 24 Aug 21 2019 hostname</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2"> abrt 6 Aug 21 2019 architecture</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 70033 Aug 21 2019 maps</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 1323 Aug 21 2019 limits</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 88 Aug 21 2019 cgroup</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 4 Aug 21 2019 type</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 90 Aug 21 2019 reason</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 39 Aug 21 2019 pwd</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 5 Aug 21 2019 pid</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 2072 Aug 21 2019 open_fds</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 48 Aug 21 2019 executable</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 14722 Aug 21 2019 environ</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 48 Aug 21 2019 cmdline</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 4 Aug 21 2019 analyzer</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 5 Aug 21 2019 abrt_version</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 886996992 Aug 21 2019 coredump</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 7 Aug 21 2019 username</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 1846076 Aug 21 2019 sosreport.tar.xz</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 0 Aug 21 2019 event_log</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 93 Aug 21 2019 machineid</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 378414 Aug 21 2019 core_backtrace</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 40 Aug 21 2019 uuid</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 1424 Aug 21 2019 dso_list</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 199 Aug 21 2019 var_log_messages</font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 2 <b>Jul 25 08:00</b> <b>count</b></font></div><div><font face="courier" size="2">-rw-r-----. 1 </font><span style="font-family: courier; font-size: small;">abrt </span><font face="courier" size="2">abrt 10 <b>Jul 25 08:00</b> <b>last_occurrence</b></font></div></div><div><font face="courier" size="2"><br /></font></div><div><font face="courier" size="2">[ccpp-2019-08-21-13:59:02-31929]# <b>cat count</b></font></div><div><font face="courier" size="2"><b>2</b></font></div><div><font face="courier" size="2"><br /></font></div><div><div><font face="courier" size="2">[ccpp-2019-08-21-13:59:02-31929]# <b>cat last_occurrence</b></font></div><div><font face="courier" size="2"><b>1595664006</b></font></div></div><div><font face="courier" size="2"><br /></font></div><div><div><font face="courier" size="2">[ccpp-2019-08-21-13:59:02-31929]# <b>date -u -d @1595664006</b></font></div><div><font face="courier" size="2">Sat <b>Jul 25 08:00</b>:06 UTC 2020</font></div></div><div><font face="courier" size="2"><br /></font></div><div><div><font face="courier" size="2">[ccpp-2019-08-21-13:59:02-31929]# <b>cat reason</b></font></div><div><font face="courier" size="2">Process /u01/app/xxx/server/bin/yyy was killed by signal 11 (SIGSEGV)</font></div></div></div><div><ul type="disc"><ul type="circle"><ul type="square">
</ul>
</ul>
</ul></div><div><br /></div><div><h3 style="text-align: left;">ABRT Configuration Files</h3><div><br /></div>Standard ABRT installation currently provides the following ABRT specific configuration files:<br /><ul style="text-align: left;"><li><b>/etc/abrt/abrt.conf </b>— allows you to modify the behavior of the abrtd service.</li><li><b>/etc/abrt/abrt-action-save-package-data.conf</b> — allows you to modify the behavior of the abrt-action-save-package-data program.</li><li><b>/etc/abrt/plugins/CCpp.conf</b> — allows you to modify the behavior of ABRT's core catching hook.</li></ul><div>For example, the default location where problem data directories are created and in which problem core dumps and all other problem data are stored is:</div><div><font face="courier" size="2"><b></b></font><blockquote><font face="courier" size="2"><b>/var/spool/abrt</b></font></blockquote></div><div><br /></div><div><font face="courier" size="2">[~]# cd /var/spool/abrt</font></div><div><font face="courier" size="2"><br /></font></div><div><div><font face="courier" size="2">[abrt]# ls -lrt</font></div><div><font face="courier" size="2">total 32</font></div><div><font face="courier" size="2">-rw-------. 1 root root 23 Mar 8 05:18 last-via-server</font></div><div><font face="courier" size="2">-rw-------. 1 root root 48 Jul 25 08:00 last-ccpp</font></div><div><font face="courier" size="2">drwxr-x---. 2 abrt abrt 4096 Jul 28 15:22 ccpp-2019-08-21-13:59:02-31929</font></div></div><div><br /></div><div>Read [11] for all the details of ABRT configuration files.</div><div><br /></div><h3 style="text-align: left;">References</h3><div><ol style="text-align: left;"><li><a href="https://buildmedia.readthedocs.org/media/pdf/abrt/latest/abrt.pdf" target="_blank">ABRT Documentation (Release 2.14)</a></li><li><a href="https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/6/html/deployment_guide/sect-abrt-cli_deleting_problems" target="_blank">How to properly delete a report problem in ABRT</a></li><li><a href="https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/6/html/deployment_guide/ch-abrt" target="_blank">AUTOMATIC BUG REPORTING TOOL (ABRT)</a></li><li><a href="https://access.redhat.com/articles/2134281" target="_blank">Elements collected by ABRT</a></li><li><a href="https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/6/html/deployment_guide/ch-abrt#tabl-abrt" target="_blank">Basic ABRT components</a></li><li><a href="https://linux.die.net/man/1/abrt-action-analyze-backtrace" target="_blank">abrt-action-analyze-backtrace</a></li><ul><li>Analyzes C/C++ backtrace, generates duplication hash, backtrace rating, and identifies crash function in problem directory DIR</li><li>Then it saves this data as new elements <b>global_uuid</b>, <b>rating</b>, <b>crash_function</b> in this problem directory</li></ul><li><a href="https://www.systutorials.com/docs/linux/man/1-abrt-backtrace/" target="_blank">abrt-backtrace</a></li><li><a href="https://abrt.readthedocs.io/en/latest/faq.html" target="_blank">ABRT FAQ</a></li><li><a href="https://abrt.readthedocs.io/en/latest/design.html" target="_blank">ABRT Design</a></li><li>backtrace_rating (<a href="https://www.blogger.com/#">Red Hat doc</a>)</li><ul><li>Numerical representation of quality of backtrace based on ratio of unrecognized frames among all backtrace frames</li></ul><li><font color="#252525"><a href="https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/6/html/deployment_guide/sect-abrt-configuration-abrt" target="_blank">ABRT SPECIFIC CONFIGURATION</a></font></li></ol></div></div></div></div>Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com49tag:blogger.com,1999:blog-748094882401183761.post-87704375891452952602020-05-31T14:08:00.002-05:002022-12-02T11:40:46.902-06:00How to Setup a Standalone Memory Analyzer for Windows 10The <a href="https://wiki.eclipse.org/MemoryAnalyzer" target="_blank">Eclipse Memory Analyzer</a> is a fast and feature-rich Java heap analyzer that helps you find memory leaks and analyze <a href="http://xmlandmore.blogspot.com/search/label/OOM" target="_blank">high memory consumption</a> issues.<br />
<div>
<br /></div>
<div>
<h3>
Standalone vs Plug-ins</h3>
<br />
<div>
You can install the Memory Analyzer into an Eclipse IDE (see [1]). However, a standalone Memory Analyzer is useful if you do not want to install a full-fledged IDE on the system you are running the <a href="http://xmlandmore.blogspot.com/search/label/Heap%20Analysis" target="_blank">heap analysis</a>. To download a standalone Memory Analyzer, click <a href="https://www.eclipse.org/mat/downloads.php" target="_blank">here</a>.</div>
<div>
<br /></div>
<div>
<h3>
Prerequisite</h3>
</div>
<div>
<br /></div>
<div>
For this illustration, we have downloaded</div>
<blockquote style="border: none; margin: 0px 0px 0px 40px; padding: 0px;">
<div style="text-align: left;">
Eclipse Memory Analyzer Version 1.10.0 ―Windows (x86_64)</div>
</blockquote>
<div>
which <span style="background-color: orange;">requires a minimum Java version of 1.8.0</span>.</div>
<div>
<br /></div>
<div>
<h3>
Setups</h3>
</div>
<div>
<br /></div>
<div>
After unzipping the file, a new folder named <i>mat </i>was created:</div>
</div>
<blockquote style="border: none; margin: 0px 0px 0px 40px; padding: 0px;">
<div>
<div style="text-align: left;">
C:\Users\<username>\Downloads\mat</div>
</div>
</blockquote>
<div>
<div>
<br /></div>
<div>
You can create a Windows Command Script (<i>.cmd</i>) with the same name in the same folder using the following content:</div>
<div>
<br /></div>
<div>
<div>
<span style="font-family: "courier"; font-size: x-small;">set PATH=C:\Program Files\Java\jdk-10\bin;</span></div>
<div>
<span style="font-family: "courier"; font-size: x-small;">start MemoryAnalyzer.exe</span></div>
</div>
<div>
<br /></div>
<div>
To avoid running MAT with the wrong JRE, we have set its PATH environment variable pointing to a JDK installation with Java version of 18.3.0:</div>
<div>
<br /></div>
<div>
<span style="font-family: "courier"; font-size: x-small;">$ cd "/cygdrive/c/Program Files/Java/jdk-10/bin"</span></div>
<div>
<div>
<span style="font-family: "courier"; font-size: x-small;">$ ./java.exe --version</span></div>
<div>
<span style="font-family: "courier"; font-size: x-small;">java 10 2018-03-20</span></div>
<div>
<span style="font-family: "courier"; font-size: x-small;">Java(TM) SE Runtime Environment 18.3 (build 10+46)</span></div>
<div>
<span style="font-family: "courier"; font-size: x-small;">Java HotSpot(TM) 64-Bit Server VM 18.3 (build 10+46, mixed mode)</span></div>
</div>
<div>
<br /></div>
<div>
To enable MAT handling large heap dumps (i.e., .hprof), you may increase the heap size of MAT runtime by changing its <i>MemoryAnalyzer.ini</i> in the same folder:<sup>[<a href="https://wiki.eclipse.org/MemoryAnalyzer/FAQ#Problems_Starting_the_Memory_Analyzer" target="_blank">7</a>]</sup></div>
<div>
<br /></div>
<div>
<div>
<span style="font-family: "courier"; font-size: x-small;">-startup</span></div>
<div>
<span style="font-family: "courier"; font-size: x-small;">plugins/org.eclipse.equinox.launcher_1.5.0.v20180512-1130.jar</span></div>
<div>
<span style="font-family: "courier"; font-size: x-small;">--launcher.library</span></div>
<div>
<span style="font-family: "courier"; font-size: x-small;">plugins/org.eclipse.equinox.launcher.win32.win32.x86_64_1.1.700.v20180518-1200</span></div>
<div>
<span style="font-family: "courier"; font-size: x-small;">-vmargs</span></div>
<div>
<span style="background-color: orange; font-family: "courier"; font-size: x-small;">-Xmx10g</span></div>
</div>
<div>
<br /></div>
<div>
For example, we have set its max heap size to be 10 GB.</div>
<div>
<br /></div>
<h3>
Getting a Heap Dump</h3>
<div>
<br /></div>
<div>
The Memory Analyzer can work with HPROF binary formatted <a href="https://docs.oracle.com/javase/8/docs/technotes/samples/hprof.html" target="_blank">heap dumps</a>. Those heap dumps are written by HotSpot and any VM derived from HotSpot. Depending on your scenario, your OS platform and your JDK version, you may have different options to acquire a heap dump.<sup>[2]</sup></div>
<div>
<br /></div>
</div>
<div>
<div>
As a developer, you want to <span style="background-color: orange;">trigger a heap dump on demand</span>. On Windows, use <i>JDK </i>and <i><a href="https://docs.oracle.com/javase/7/docs/technotes/guides/management/jconsole.html" target="_blank">JConsole</a></i>. On Linux and Mac OS X, you can also use <i>jmap or jcmd </i>that comes with JDK.</div>
<div>
<br /></div>
<div>
<br /></div>
<div>
<b>Via MAT:</b></div>
<div>
<ul style="text-align: left;">
<li>You can use <a href="https://community.bonitasoft.com/acquire-heap-dump-mat-memory-analyzer-tool" target="_blank">Acquiring Heap Dump Dialog</a> to acquire a heap dump from a locally running Java process</li>
</ul>
<div>
<br /></div>
</div>
<div>
<b>Via Java VM parameters:</b><br />
<ul style="text-align: left;">
<li>-XX:+HeapDumpOnOutOfMemoryError –XX:HeapDumpPath=[file path]</li>
<ul>
<li>writes heap dump on the first Out Of Memory Error (recommended)</li>
</ul>
<li>-XX:+HeapDumpOnCtrlBreak </li>
<ul>
<li>writes heap dump together with thread dump on CTRL+BREAK</li>
<li>-XX:+HeapDumpOnCtrlBreak in HotSpot JVM (by Sun/Oracle) is present in 1.4.2_12 or higher and 1.5.0_14 or higher. <span style="background-color: #f7cb4d;">F</span><span style="background-color: orange;">or JVMs 1.6, 1.7, 1.8 this option is no more present</span>, but you can use the "jmap" or "jcmd" tools.</li>
</ul>
</ul>
</div>
<div>
<br />
<b>Via Tools:</b><br />
<ul style="text-align: left;">
<li><i>jmap</i></li>
<ul>
<li><span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">jmap -dump:format=b,file=snapshot.jmap <process id></span></li>
<li>It is <span style="background-color: orange;">recommended to use the latest utility <i>jcmd </i>instead of <i>jmap </i>utility</span> for enhanced diagnostics and reduced performance overhead. </li>
</ul>
<li><i>jcmd</i></li>
<ul>
<li><span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">jcmd <process id/main class> GC.heap_dump Myheapdump</span></li>
</ul>
<li><a href="https://docs.oracle.com/javase/7/docs/technotes/guides/management/jconsole.html" target="_blank"><i>JConsole</i></a></li>
<ul>
<li>Launch jconsole.exe and invoke operation dumpHeap() on HotSpotDiagnostic MBean</li>
</ul>
<li><a href="https://help.sap.com/doc/saphelp_nw74/7.4.16/en-US/5f/d99052023d414aa1dc6aec5c806360/content.htm?no_cache=true" target="_blank"><i>SAP JVMMon</i></a></li>
<ul>
<li>Launch jvmmon.exe and call menu for dumping the heap</li>
</ul>
</ul>
Example 1 Create a Heap Dump using jmap</div>
<div>
<br /></div>
<div>
<div>
<span style="font-size: x-small;"><span style="font-family: "courier"; font-size: xx-small;">bash-4.2$ ${JAVA_HOME}/bin/jmap -dump:format=b,file=</span><span style="font-family: "courier"; font-size: x-small;">MyJmapHeapdump</span><span style="font-family: "courier"; font-size: xx-small;">.hprof 82734</span></span></div>
<div>
<span style="font-size: x-small;"><span style="font-family: "courier"; font-size: xx-small;">Dumping heap to /tmp/NM_OOM/</span><span style="font-family: "courier"; font-size: x-small;">MyJmapHeapdump</span><span style="font-family: "courier"; font-size: xx-small;">.hprof ...</span></span></div>
<div>
<span style="font-family: "courier"; font-size: x-small;">Heap dump file created</span></div>
</div>
<div>
<br /></div>
<div>
Example 2 Create a Heap Dump using jcmd</div>
<div>
<br /></div>
<div>
<div>
<span style="font-family: "courier"; font-size: x-small;">$ /bi/app/jdk/bin/jcmd 82734 GC.heap_dump MyJcmdHeapdump.hprof</span></div>
<div>
<span style="font-family: "courier"; font-size: x-small;">82734:</span></div>
<div>
<span style="font-family: "courier"; font-size: x-small;">Heap dump file created</span></div>
</div>
<div>
<br /></div>
<div>
<h4 style="text-align: left;">
Notes</h4>
<div>
<ul style="text-align: left;">
<li>By default, the heap dump will be generated in the "current directory" of the Java application.<sup>[6]</sup> </li>
<ul>
<li><i>jmap </i>generates heap dump in the directory where you run <i>jmap</i>, which is different from <i>jcmd's</i> behavior.</li>
</ul>
<li>The <span style="background-color: orange;">dump file can be huge</span>, up to Gigabytes, so ensure that the target file system has enough space.</li>
<li>Need to <span style="background-color: orange;">login as the same user</span> as your process' to attach to it</li>
</ul>
<div>
<br /></div>
</div>
</div>
<div>
<h3>
References</h3>
</div>
</div>
<div>
<ol>
<li><a href="https://www.eclipse.org/mat/downloads.php" target="_blank">Standalone MAT downloads</a></li>
<li><a href="https://wiki.eclipse.org/MemoryAnalyzer" target="_blank">MemoryAnalyzer Getting Started</a></li>
<li><a href="https://www.vogella.com/tutorials/EclipseMemoryAnalyzer/article.html" target="_blank">Eclipse Memory Analyzer (MAT) - Tutorial</a></li>
<li><a href="https://stackoverflow.com/questions/542979/using-heapdumponoutofmemoryerror-parameter-for-heap-dump-for-jboss" target="_blank">Using HeapDumpOnOutOfMemoryError parameter for heap dump for JBoss</a></li>
<li><a href="https://community.bonitasoft.com/acquire-heap-dump-mat-memory-analyzer-tool" target="_blank">Acquire Heap Dump from MAT (Memory Analyzer Tool)</a></li>
<li><a href="https://docs.oracle.com/javase/8/docs/technotes/guides/troubleshoot/memleaks004.html#CIHCGHJI" target="_blank">Diagnose Leaks in Java Language Code</a></li>
<li><a href="https://wiki.eclipse.org/MemoryAnalyzer/FAQ#Problems_Starting_the_Memory_Analyzer" target="_blank">Problems Starting the Memory Analyzer</a></li><li><a href="https://medium.com/@chrishantha/basic-concepts-of-java-heap-dump-analysis-with-mat-e3615fd79eb" target="_blank">Basic Concepts of Java Heap Dump Analysis with MAT</a></li></ol>
</div>
Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com24tag:blogger.com,1999:blog-748094882401183761.post-72499599574615754702019-04-04T16:13:00.011-05:002021-06-06T17:24:01.582-05:00OAC―Working with Oracle BI Administration Tool<div dir="ltr" style="text-align: left;" trbidi="on">
<meta name="viewport" content="width=device-width, initial-scale=1"><div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/4KTUjJQG1a4/0.jpg" frameborder="0" height="266" src="https://www.youtube.com/embed/4KTUjJQG1a4?feature=player_embedded" width="320"></iframe></div>
<div class="separator" style="clear: both;">
</div>
<div style="text-align: center;">
<span style="font-family: inherit; font-size: x-small;"><b>Video 1. </b><b>Create Simple Repository in OBIEE 12C</b></span></div>
<br />
<br />
<div class="style-scope ytd-video-primary-info-renderer" id="info" style="align-items: center; background: rgb(255, 255, 255); border: 0px; display: flex; flex-direction: row; font-family: roboto, arial, sans-serif; font-size: 10px; margin: 0px; padding: 0px;">
</div>
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/2E_O4glKsks/0.jpg" frameborder="0" height="266" src="https://www.youtube.com/embed/2E_O4glKsks?feature=player_embedded" width="320"></iframe></div>
<div class="separator" style="clear: both; text-align: center;">
<span style="font-family: inherit; font-size: x-small;"><b>Video 2. Working with Oracle BI Administration Tool</b></span></div>
<br />
Administrators can upload data models built with <a href="https://docs.oracle.com/middleware/12212/biee/BIEMG/GUID-BB4F6611-A412-4077-8998-D0EC2CCF2F45.htm#about_bi_serv_arch" target="_blank">Oracle BI Enterprise Edition</a> (<b>OBIEE</b>) to <a href="https://xmlandmore.blogspot.com/2019/02/oacgetting-started-with-oracle.html" target="_blank">Oracle Analytics Cloud</a> (<b>OAC</b>). After uploading a data model file (.rpd) to the cloud, content authors can then build data visualizations, dashboards and analyses in the usual way.<sup>[1]</sup><br />
<br />
<div>
In this article, we will cover below three topics:</div>
<div>
<ol>
<li>Use the <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/download-and-install-analytics-client-tools-oracle-analytics-cloud.html" target="_blank">Administration Tool</a> to view and modify the BI Repository</li>
<li>Describe the different layers of the BI Repository</li>
<li>Upload Data Models from a File (.rpd) Using OAC Console</li>
</ol>
</div>
To cover these topics, we will begin with <a href="https://docs.oracle.com/middleware/12212/biee/BIEMG/GUID-64336D4E-945B-4401-B2CC-4CD09DC41C2D.htm#admin_tool_overview" target="_blank">Oracle BI Administration Tool</a> in OBIEE<b> (</b>watch video 1&2); then we will switch to OAC to discuss how to upload a data model file (.rpd or BI repository) from OBIEE to the cloud.<sup>[1]</sup><br />
<br />
<table cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgcAqSwz9fur1KK2qjJW-S6nPMwUjDtQJD7vpp33uu7Fhh7Jx3Dz5E3JKjOShP4BHs8C5DYNBemhkO7eM4x9eApJB885ekS6vxg87LsgTs8LPAF7CfOdqnXmC-QVzFBYLHSaMWmQYCovqad/s1600/BI_repository_3layers.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="587" data-original-width="1493" height="218" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgcAqSwz9fur1KK2qjJW-S6nPMwUjDtQJD7vpp33uu7Fhh7Jx3Dz5E3JKjOShP4BHs8C5DYNBemhkO7eM4x9eApJB885ekS6vxg87LsgTs8LPAF7CfOdqnXmC-QVzFBYLHSaMWmQYCovqad/s640/BI_repository_3layers.jpg" width="560" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 1. Physical / Business Model and Mapping / Presentation (3 layers in BI Repository)</b></td></tr>
</tbody></table>
<span style="color: black; display: inline; float: none; font-family: "times new roman"; font-size: small; font-style: normal; font-weight: 400; letter-spacing: normal; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px;"></span><br />
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="-webkit-text-stroke-width: 0px; font-family: "times new roman"; letter-spacing: normal; margin-bottom: 0.5em; margin-left: auto; margin-right: auto; orphans: 2; padding: 6px; text-align: center; text-decoration-color: initial; text-decoration-style: initial; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px;"><tbody>
<tr><td style="text-align: center;"><div style="margin: 0px;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEic8habp4hyMkpqPBB7E9lZShkXO83ixsg5ceL36zx2DxgPp92ojL2Wan9NPhn_dNewYsaXmQKSOIOKF8d4Z-crjmem0_GVkFxkk_M3uBwxWj_XUPsC0hszFbsDEeztosuh1EEZKUUAVMVV/s1600/OracleBI_Administration_Tool.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="414" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEic8habp4hyMkpqPBB7E9lZShkXO83ixsg5ceL36zx2DxgPp92ojL2Wan9NPhn_dNewYsaXmQKSOIOKF8d4Z-crjmem0_GVkFxkk_M3uBwxWj_XUPsC0hszFbsDEeztosuh1EEZKUUAVMVV/s1600/OracleBI_Administration_Tool.jpg" style="cursor: move;" /></a></div>
</td></tr>
<tr><td class="tr-caption" style="font-size: 12.8px; padding-top: 4px; text-align: center;"><div style="margin: 0px;">
<b>Figure 2. How Administration Tool interacts with Repository and Oracle BI Server</b><br />
<b><br /></b></div>
</td></tr>
</tbody></table>
<h3>
</h3>
<h3>
Oracle BI Repository (OBIEE)</h3>
<br />
To view and edit the different layers of repository (see Figure 1), you use the <a href="https://docs.oracle.com/middleware/12212/biee/BIEMG/GUID-64336D4E-945B-4401-B2CC-4CD09DC41C2D.htm#admin_tool_overview" target="_blank">Oracle BI Administration Tool</a>. The <a href="https://www.ateam-oracle.com/working-with-the-developer-client-tool-for-oracle-analytics-cloud-oac-with-adw-in-a-proxy-enabled-network" target="_blank">Administration Tool client</a> is a Windows application that you can use to create and edit your Oracle BI repository.<sup>[10,11]</sup> The Administration Tool can connect directly to the repository in offline mode, or it can connect to the repository through the Oracle BI Server. Some options are only available in online mode. See <a href="https://docs.oracle.com/middleware/12212/biee/BIEMG/GUID-A644C2C8-25B3-4479-8E85-65F664B2BE7D.htm#GUID-A644C2C8-25B3-4479-8E85-65F664B2BE7D">Using Online and Offline Repository Modes</a>.<br />
<br />
In Figure 2, it shows how the Oracle BI Administration Tool interacts with Oracle BI Server, data sources, and the Oracle Business Intelligence (BI) repository. The Oracle BI repository contains the metadata that defines which columns you can include in <a href="https://www.youtube.com/watch?v=9ySvJ9gJUso" style="background-color: yellow;" target="_blank">analyses</a>, and the source of that data. The repository is organized into <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/use-subject-area-data-set.html" target="_blank">subject areas</a>, which contain folders with the columns.<br />
<br />
<div>
<br />
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhH0-ZnWfXySAOqaO2yRXzxKjjmG8Pz5n9ukxGbQzlj7qWk9rBVDAMHoGlzjGac95AKWwaCiMvwdGeebNSME0WA5ui3X6mMWj9010yylwtNTJuLKI65_YTXFHMzHeVBi7IWYaO-de-adueU/s1600/import_metadata.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="342" data-original-width="916" height="206" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhH0-ZnWfXySAOqaO2yRXzxKjjmG8Pz5n9ukxGbQzlj7qWk9rBVDAMHoGlzjGac95AKWwaCiMvwdGeebNSME0WA5ui3X6mMWj9010yylwtNTJuLKI65_YTXFHMzHeVBi7IWYaO-de-adueU/s640/import_metadata.jpg" width="560" /></a></td></tr>
<tr><td class="tr-caption"><b>Figure 3. Import Metadata for the Physical Layer ― Select Data Source</b></td></tr>
</tbody></table>
</div>
<div>
<ol>
</ol>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhRa8U8u3zoRIvBD91wlNaE0ckntJVVral0zzfUwFvOnhwAvyogoyHRMz_SYlki0SVp5Uwo6G-lA399N90O7ZEWI8-n4ZOrXJzj7HJfMjAr7x1_RxKibv7pNtdphtY8MC6HKjbnhTxmE8Cr/s1600/Logical_Physical_Mapping.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="478" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhRa8U8u3zoRIvBD91wlNaE0ckntJVVral0zzfUwFvOnhwAvyogoyHRMz_SYlki0SVp5Uwo6G-lA399N90O7ZEWI8-n4ZOrXJzj7HJfMjAr7x1_RxKibv7pNtdphtY8MC6HKjbnhTxmE8Cr/s1600/Logical_Physical_Mapping.jpg" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 4. Mapping between the business model (or logical schemas) and the physical schemas</b></td></tr>
</tbody></table>
<div class="separator" style="clear: both; text-align: center;">
</div>
<div>
<br /></div>
<h3>
Tiers</h3>
<div>
<br />
Layers in the <a href="https://docs.oracle.com/middleware/12212/biee/BIEMG/GUID-B4BE0D64-C369-435E-B97C-F377E617A015.htm#about_repos_planning" target="_blank">Oracle BI Repository</a> define the objects and their relationships. An Oracle BI Repository has the following layers (see Figure 1):</div>
<ol>
<li><b>Physical</b></li>
<ul>
<li>Defines the objects and relationships that the <a href="https://www.rittmanmead.com/blog/2010/02/inside-the-oracle-bi-server-part-1-the-bi-server-architecture/" target="_blank">Oracle BI Server</a> needs to write native queries against each physical data source.</li>
<ul>
<li>Include metadata representation of the physical data sources (Note that no data are included)</li>
</ul>
<li>You create this layer by importing tables, cubes, and flat files from your data sources.</li>
<ul>
<li>You can use <i>Import Metadata</i> from the <i>File </i>menu and setup data sources with appropriate connection information (see Figure 3).</li>
</ul>
<li>Separating the logical behavior of the application from the physical model:</li>
<ul>
<li>Provides the ability to federate multiple physical sources to the same logical object, enabling aggregate navigation and partitioning, as well as, dimension conformance and isolation from changes in the physical sources. </li>
<li>Enables the creation of portable Oracle BI Applications.</li>
</ul>
</ul>
<li><b>Business Model and Mapping</b></li>
<ul>
<li>Specifies the mapping between the business model and the physical schemas.</li>
<ul>
<li>Determines the analytic behavior seen by users, and defines the superset of objects and relationships available to users. </li>
<li>Hides the complexity of the source data models.</li>
</ul>
<li>At run time, the Oracle BI Server </li>
<ul>
<li>Evaluates Logical SQL requests against the business model</li>
<li>Uses the mappings to determine the best set of physical tables, files, and cubes for generating the necessary physical queries. </li>
<ul>
<li>The mappings often contain calculations and transformations, and might combine multiple physical tables.</li>
</ul>
</ul>
<li>In each logical schema</li>
<ul>
<li>There is an extra folder named "Sources" which point to the physical schemas that the logical schema is coming from.</li>
<ul>
<li>You can have multiple physical schemas (i.e. CUSTOMERS & COUNTRIES) in the Sources folder (see Figure 4).</li>
</ul>
<li>Each column in business model maps to one or more columns in the Physical layer.</li>
</ul>
</ul>
<li><b>Presentation </b></li>
<ul>
<li>The users view of the business model </li>
<ul>
<li>Adds a level of abstraction over the Business Model and Mapping layer</li>
<li>Provides a way to present customized, secure, role based views of a business model to users. </li>
</ul>
<li>The repository in presentation layer is organized into <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/use-subject-area-data-set.html" target="_blank">subject areas</a>. After you upload BI repository to the cloud (see the section below for more details), new subject areas will be shown in Analyses of OAC (see Figure 5&6).</li>
</ul>
</ol>
<div>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEia1lv7C3mPf6Qd_akEeMDgLCAs8ZM5w3XKHE3MLe53hWpRYjkJD44n7LBlDUv3JzzAHMErdmO9fsdA3AWJ7-ttK5CAVewl0EMFmJnuVu02BX3_KUsjR1BTF4SaJAQQbQPGlIPz5WIyG_Sy/s1600/OAC_Create_Dashboard.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="641" data-original-width="308" height="640" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEia1lv7C3mPf6Qd_akEeMDgLCAs8ZM5w3XKHE3MLe53hWpRYjkJD44n7LBlDUv3JzzAHMErdmO9fsdA3AWJ7-ttK5CAVewl0EMFmJnuVu02BX3_KUsjR1BTF4SaJAQQbQPGlIPz5WIyG_Sy/s640/OAC_Create_Dashboard.jpg" width="305" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 5. Creating a new Analysis</b></td></tr>
</tbody></table>
<div class="separator" style="clear: both; text-align: center;">
</div>
<h3>
</h3>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEifqSwhJMuYAg7zd6EnLA-YHxOhevhxbgw05v_VYp8LrGKfSEnaNMvCEDtw4rnf3UMW3UIkwmQsXrA2x0OvvHAwy6QVQfIxSJLzMayJBHSu6u01ma8ngbPdEJMvzxJBjYL0uMY-wkULpItJ/s1600/OAC_Select_Subject_Area.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="518" data-original-width="427" height="400" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEifqSwhJMuYAg7zd6EnLA-YHxOhevhxbgw05v_VYp8LrGKfSEnaNMvCEDtw4rnf3UMW3UIkwmQsXrA2x0OvvHAwy6QVQfIxSJLzMayJBHSu6u01ma8ngbPdEJMvzxJBjYL0uMY-wkULpItJ/s400/OAC_Select_Subject_Area.jpg" width="328" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 6. Select Subject Area</b></td></tr>
</tbody></table>
<h3>
</h3>
<h3>
Business Intelligence (BI) Repository</h3>
<br />
You use Oracle BI Administration Tool to view and modify the repository. After finish, you can save the metadata into a <i>data model file</i> (the RPD file). Administrators can then upload data models built with OBIEE to <a href="https://xmlandmore.blogspot.com/2019/02/oacgetting-started-with-oracle.html" target="_blank">Oracle Analytics Cloud</a> (<b>OAC</b>) instead of using <a href="https://xmlandmore.blogspot.com/2019/03/oacknowing-dimensional-modelling-basics.html" target="_blank">Data Modeler</a> to build them from scratch.<br />
<br />
The business intelligence (BI) repository contains the metadata that defines which columns you can include in analyses, and the source of that data. The repository is organized into <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/use-subject-area-data-set.html" target="_blank">subject areas</a>:<br />
<ul>
<li>Which contain folders with the columns (see Figure 7)</li>
<ul>
<li>For example, <i>Region </i>column is in the <i>Geography </i>folder which, in turn, is in <i>SampleApp </i>subject area</li>
</ul>
<li>Have one <i>fact</i> folder and a number of <i>dimension</i> folders. </li>
<ul>
<li>Folders can have subfolders.</li>
</ul>
</ul>
When you create an analysis (see Figure 5), you do:<br />
<ul>
<ul>
<li>Select a subject area (see Figure 6) which contains columns related to a specific business object or business area. </li>
<ul>
<li>For example, <i>SampleApp </i>(see Figure 7).</li>
</ul>
<li>Then open folders within the subject area to find the columns to include in your analysis.</li>
<ul>
<li>For example, you can open the <i>Geography </i>folder and select the columns within it.</li>
</ul>
<li>You can watch <a href="https://www.youtube.com/watch?v=ya42cDjN5Lo" style="background-color: yellow;" target="_blank">video 3</a> for more details.</li>
</ul>
</ul>
<div>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhKyU1BxLfYtlz3eW7kMw0bvkjM4izOF65XMXQLQwsCyrAcJQ34VOS7VSzWRThAwpP2wnuQ5v1FqPdxDwypCyqJxbWmIFc0p1o5U3osTvvi1WPKfo6Tg6l_Jzst7O-t_bQ5X4gqMzFE_qDS/s1600/OAC_Working_with_Subject_Area.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="499" data-original-width="277" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhKyU1BxLfYtlz3eW7kMw0bvkjM4izOF65XMXQLQwsCyrAcJQ34VOS7VSzWRThAwpP2wnuQ5v1FqPdxDwypCyqJxbWmIFc0p1o5U3osTvvi1WPKfo6Tg6l_Jzst7O-t_bQ5X4gqMzFE_qDS/s1600/OAC_Working_with_Subject_Area.jpg" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 7. Selecting <i>Region </i>column within the <i>Geography </i>folder</b></td></tr>
</tbody></table>
<br />
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/ya42cDjN5Lo/0.jpg" frameborder="0" height="266" src="https://www.youtube.com/embed/ya42cDjN5Lo?feature=player_embedded" width="320"></iframe></div>
<div class="separator" style="clear: both; text-align: center;">
<b><span style="font-size: x-small;">Video 3. Get Started with Analyses and Dashboards in OAC</span></b></div>
<br /></div>
<h3>
Get Your Data Model File Ready</h3>
<br />
Before you upload data model file to Oracle Analytics Cloud, take some time to ready your data model for the cloud:<sup>[2]</sup><br />
<ol>
<li>Verify that you’re using <b>Oracle BI Enterprise Edition 11.1.1.7 or later</b>.</li>
<li>Validate the data model file (the RPD file).</li>
<ul>
<li>Run <b>consistency checks</b> using Consistency Check Manager in Oracle BI Administration Tool.</li>
</ul>
<li>Verify that the data model file includes connection details to Oracle Database Cloud Service.</li>
<ul>
<li>Review the connection pool settings from Oracle BI Administration Tool:</li>
<ul>
<li><b>Data source name</b> must contain the full connect string for the Oracle Database Cloud Service where data is stored.</li>
<ul>
<li>You can’t specify a net service name here.</li>
</ul>
<li><b>Call interface</b> must be Oracle Call Interface (OCI).</li>
</ul>
<li>If your data model file connects to multiple Oracle Database Cloud Service instances, <u>ensure that the settings for each connection pool are correct</u>.</li>
</ul>
<li>Disable subject areas that you don't want to expose or that don't have a working connection.</li>
<ul>
<li>If connection information is missing, users see the message Fetch subject areas failed error when they view subject areas in Oracle Analytics Cloud.</li>
</ul>
<li><u>Back up your Oracle Analytics Cloud service</u>, including the current data model, in case you need to restore this version.</li>
</ol>
When the data model is ready, you can upload it to Oracle Analytics Cloud.<br />
<br />
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgBcb5QMTDQEzO-NodQG47zD4VmRgo0S360kAam0-M-vi5-bC5wEzDd9LIV_PdCZgXFQwIWbw539XV-6p4w9Eg5T2s8vF4F2efc0xeYkHeKUIsTcv_QrkfCnY6SDDGNro0UagSI-uIFQWvv/s1600/ReplaceDataModel.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="171" data-original-width="148" height="200" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgBcb5QMTDQEzO-NodQG47zD4VmRgo0S360kAam0-M-vi5-bC5wEzDd9LIV_PdCZgXFQwIWbw539XV-6p4w9Eg5T2s8vF4F2efc0xeYkHeKUIsTcv_QrkfCnY6SDDGNro0UagSI-uIFQWvv/s200/ReplaceDataModel.jpg" width="173" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b style="font-size: 12.8px;">Figure 8. Replace Data Model</b><span style="font-size: 12.8px;"> </span></td></tr>
</tbody></table>
<div class="separator" style="clear: both; text-align: center;">
</div>
</div>
<div>
<br /></div>
<div>
<h3>
Upload Data Models from a File (.rpd) Using Console</h3>
</div>
<br />
When you upload data models from OBIEE, you delete existing data model information in Oracle Analytics Cloud and replace it with content in the data model file (.rpd). The data models you upload become available to content authors as <i>subject areas</i>.<br />
<div>
<div style="box-sizing: border-box;">
<br />
You can also upload data model files from a file (.rpd) using Console in OAC:<sup>[3]</sup><br />
<ol>
<li>Verify the data model file (.rpd) and associated database connections.</li>
<li>In Oracle Analytics Cloud, click <b>Console</b>.</li>
<li>Select <b>Service Administration - Manage Snapshots</b>.</li>
<li><u>Take a snapshot of the current data model</u> in case you need to restore this version (watch this <a href="https://www.youtube.com/watch?time_continue=98&v=VBtSiv2OGr8" style="background-color: yellow;" target="_blank">video</a>).</li>
<li>Click <b>Replace Data Model </b>(see Figure 8).</li>
<li>Click <b>Browse </b>and select the data model file (.rpd) that you want to upload.</li>
<li>Enter the password for the file.</li>
<li>Click <b>OK</b>.</li>
<li>Go to the Home page, click <b>Data</b>, and then <b>Data Sets</b> to see the data models that you uploaded, available as subject areas.</li>
<li>Optional: If the data model file includes permissions and data filters, <u>create matching application roles</u> in Oracle Analytics Cloud for the data security to work in the cloud.</li>
<ul>
<li><u>Create application roles with exactly the same names</u> as those defined in Oracle BI Administration Tool.</li>
<li><u>Assign users (and user roles) to the application roles</u> as required.</li>
</ul>
</ol>
<div>
<br /></div>
</div>
</div>
<div>
<div>
<span face="arial, helvetica, sans-serif" style="color: #333333; font-size: 14px;"></span>
<span face="arial, helvetica, sans-serif" style="color: #333333; font-size: 14px;"></span>
<br />
<h3>
References</h3>
<ol style="text-align: left;">
<li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/upload-data-models-oracle-bi-enterprise-edition.html#GUID-2BEB60F6-986D-4A7A-9D63-EEE67083E98A" target="_blank">Upload Data Models from Oracle BI Enterprise Edition</a></li>
<li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/upload-data-models-oracle-bi-enterprise-edition.html#GUID-153254C3-4B95-4962-8432-A35F6B365AB7" target="_blank">Get Your Data Model File Ready</a></li>
<li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/upload-data-models-oracle-bi-enterprise-edition.html#GUID-CD79EF23-ADD2-4301-ABE3-217AA6B39B6F" target="_blank">Upload Data Models from a File (.rpd) Using Console</a></li>
<li><a href="https://docs.oracle.com/middleware/12212/biee/BIEMG/GUID-BB4F6611-A412-4077-8998-D0EC2CCF2F45.htm#about_bi_serv_arch" target="_blank">Fusion Middleware Metadata Repository Builder's Guide for Oracle Business Intelligence Enterprise Edition</a></li>
<li><a href="https://www.youtube.com/watch?v=2E_O4glKsks" target="_blank">OBIEE 12C: BI Repository (RPD)</a> (<span style="background-color: yellow;">YouTube</span>)</li>
<li><a href="https://www.youtube.com/watch?v=4KTUjJQG1a4" target="_blank">Create Simple Repository in OBIEE 12C</a> (<span style="background-color: yellow;">YouTube</span>)</li>
<li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsmd/top-faqs-data-modeler-enterprise-data-models.html" target="_blank">Top FAQs for Data Modeler (Enterprise Data Models)</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/create-analyses.html" target="_blank">Create Analyses</a> (Oracle Analytics Cloud)</li><li><a href="https://blogs.oracle.com/analytics/cache-management-in-oracle-analytics-cloud-54-onwards-v2" target="_blank">Cache Management in Oracle Analytics Cloud 5.4 Onwards</a></li><li><a href="https://www.oracle.com/middleware/technologies/oac-tools-downloads.html" target="_blank">Oracle Analytics Client Tools (downloads)</a></li><li><a href="https://www.ateam-oracle.com/working-with-the-developer-client-tool-for-oracle-analytics-cloud-oac-with-adw-in-a-proxy-enabled-network" target="_blank">Working with the Developer Client Tool for Oracle Analytics Cloud (OAC) with ADW in a Proxy-enabled Network</a></li><ul><li>Download Developer Client Tool for OAC from here. It is <b>recommended that the Client Tool version match or be higher than the OAC version</b>.</li></ul><li>Click <a href="https://www.oracle.com/business-analytics/" target="_blank">here</a> for more A-Team Oracle Analytics (OAC) Blogs.</li><li><a href="https://docs.oracle.com/en/middleware/bi/analytics-server/security-oas/managing-security-oracle-analytics-server.pdf" target="_blank">Oracle Analytics Managing Security for Oracle Analytics Server, 5.9.0</a></li>
</ol>
</div>
</div>
</div></div>
Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com20tag:blogger.com,1999:blog-748094882401183761.post-4354823100345186222019-03-30T11:00:00.004-05:002021-06-06T17:24:39.575-05:00 OAC―Knowing the Dimensional Modelling Basics (2/2)<div dir="ltr" style="text-align: left;" trbidi="on">
<meta name="viewport" content="width=device-width, initial-scale=1"><div class="separator" style="clear: both; text-align: center;">
<br /></div>
<div style="text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/UdqDLaUB-IQ/0.jpg" frameborder="0" height="266" src="https://www.youtube.com/embed/UdqDLaUB-IQ?feature=player_embedded" width="320"></iframe></div>
<div class="separator" style="clear: both; text-align: center;">
<span style="font-size: x-small;"><b>Video 1. Create your initial data model from Relational Sources using Data Modeler</b></span></div>
<div class="separator" style="clear: both; text-align: center;">
<span style="font-size: x-small;"><b><br /></b></span></div>
<div class="separator" style="clear: both; text-align: center;">
<span style="font-size: x-small;"><b><br /></b></span><iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/rxa6B8C7X3M/0.jpg" frameborder="0" height="266" src="https://www.youtube.com/embed/rxa6B8C7X3M?feature=player_embedded" width="320"></iframe></div>
<div class="separator" style="clear: both; text-align: center;">
<b><span style="font-size: x-small;">Video 2. Create Time Dimension Tables Using Data Modeler</span></b></div>
<br />
In a previous article "<a href="http://xmlandmore.blogspot.com/2019/02/oacknowing-dimensional-modelling-basics.html" target="_blank">OAC―Knowing the Dimensional Modelling Basics (1/2)</a>", we have covered basic concepts of dimensional modeling:<br />
<div>
<ul>
<li><b>Transactional versus Analytical Systems</b></li>
<li><b>Data Warehousing</b></li>
<li><b>Dimensions, Facts and Hierarchies</b></li>
</ul>
<div class="separator" style="clear: both; text-align: center;">
</div>
<div class="separator" style="clear: both; text-align: center;">
</div>
<div class="separator" style="clear: both; text-align: center;">
</div>
<div class="separator" style="clear: both; text-align: center;">
</div>
<div class="separator" style="clear: both; text-align: center;">
</div>
<div class="separator" style="clear: both; text-align: center;">
</div>
<div>
In this article, we will cover how <a href="https://en.wikipedia.org/wiki/Dimensional_modeling" target="_blank">Dimensional Modelling</a> works in <a href="https://cloud.oracle.com/en_US/oac" target="_blank">Oracle Analytics Cloud</a> (OAC).<br />
<br />
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg2ndWSmMYWHOpziOpjbuNb2MSjEHRZGIGOGIUz7mEhsVBxrWN60Mh-iS0RILQlHzhlOTAWRR89nrt2EZTEJPJI0nFyfS8EgjYiKX8sriTNqN2ssQjsnUcz67yyrxpI85EqaN9l_nhN6g1I/s1600/OpenDataModeler.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="238" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg2ndWSmMYWHOpziOpjbuNb2MSjEHRZGIGOGIUz7mEhsVBxrWN60Mh-iS0RILQlHzhlOTAWRR89nrt2EZTEJPJI0nFyfS8EgjYiKX8sriTNqN2ssQjsnUcz67yyrxpI85EqaN9l_nhN6g1I/s1600/OpenDataModeler.jpg" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 1. Open Data Modeler in Oracle Analytics Cloud by clicking the action menu</b></td></tr>
</tbody></table>
<h3>
Data Modeler</h3>
<br />
Using <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/use-data-modeler.html#GUID-20C65028-74E0-4041-8877-035DC224F0EC" target="_blank">Data Modeler</a> (see Figure 1) you can model data from various source types, such as star and snowflake, in various ways that make sense to business users.<br />
<blockquote class="tr_bq">
Although not all source objects have star relationships,<b> Data Modeler presents data as a simple star structure in the data model</b>. In other words, <u>the data model represents measurable facts that are viewed in terms of various dimensional attributes</u>.</blockquote>
<blockquote class="tr_bq">
If you modeled your business data with <a href="https://www.oracle.com/technetwork/middleware/bi-enterprise-edition/overview/index.html" target="_blank">Oracle BI Enterprise Edition</a>, you don't have to start from scratch with Data Modeler. You can upload your data model to the cloud.<sup>[14]</sup></blockquote>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhhTc5AOEWs36QWO47YaeOG_Lp2fmnDIa-0by4ziSaOq6osoqJDIuz0eVwKVSFWdHCGm6e6_kZluOzd5Otfdf5qyPUaQolJB2LbnPc5vGziU3g_OJQmkMuMoVaxaDcQpmt92JQdyr8imOGO/s1600/DataModelerLeft.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="417" data-original-width="379" height="320" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhhTc5AOEWs36QWO47YaeOG_Lp2fmnDIa-0by4ziSaOq6osoqJDIuz0eVwKVSFWdHCGm6e6_kZluOzd5Otfdf5qyPUaQolJB2LbnPc5vGziU3g_OJQmkMuMoVaxaDcQpmt92JQdyr8imOGO/s320/DataModelerLeft.jpg" width="290" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 2. Left Pane in Data Modeler</b></td></tr>
</tbody></table>
<br />
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiCAXWI_GNH17QasQGWxb3JXSEqr-iOKbr3vj4LIeHJFwAHBgUya7XY99QBsgNv3mJUINYrFkfYNKlrd_EMhi4KeXOMW1jyKRc_X_l_7F2mTHp9K4JEbvn81f0Nv0ZULz67VYV25BrBh2Q-/s1600/DataModelerActionMenu.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="168" data-original-width="336" height="160" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiCAXWI_GNH17QasQGWxb3JXSEqr-iOKbr3vj4LIeHJFwAHBgUya7XY99QBsgNv3mJUINYrFkfYNKlrd_EMhi4KeXOMW1jyKRc_X_l_7F2mTHp9K4JEbvn81f0Nv0ZULz67VYV25BrBh2Q-/s320/DataModelerActionMenu.jpg" width="320" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 3. Action menu associated with Objects in Data Modeler</b></td></tr>
</tbody></table>
<br />
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi1axVZHnRC3CsUv38v1APy2hNa7jKcGYgL5DfcupbX-qCPnYO2ji0UG5ffO0_a4EM1l9pOTulawkp1c8qs08iHmKWnMICsap2WSNJI_lXh1VnlzLj9hoG77qBeUNCyfg5bs_rrk2_oGxmz/s1600/CreateDataModel.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="427" data-original-width="1600" height="148" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi1axVZHnRC3CsUv38v1APy2hNa7jKcGYgL5DfcupbX-qCPnYO2ji0UG5ffO0_a4EM1l9pOTulawkp1c8qs08iHmKWnMICsap2WSNJI_lXh1VnlzLj9hoG77qBeUNCyfg5bs_rrk2_oGxmz/s640/CreateDataModel.jpg" width="560" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 4. Create Data Model in OAC</b><br />
<b><br /></b></td></tr>
</tbody></table>
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/F0UJ9tOLmpQ/0.jpg" frameborder="0" height="266" src="https://www.youtube.com/embed/F0UJ9tOLmpQ?feature=player_embedded" width="320"></iframe></div>
<div class="separator" style="clear: both; text-align: center;">
<b><span style="font-size: x-small;">Video 3. Create Hierarchies for Dimension Tables Using Data Modeler</span></b></div>
<br />
<h3>
Data Modeling Tasks</h3>
<br />
When building a data model in OAC, you perform the following tasks:<sup>[3]</sup><br />
<ul>
<li><b>Connect to the database</b> containing your business data</li>
<ul>
<li>In Data Modeler, the left pane shows the <b><span style="color: blue;">Database</span></b>, <b><span style="color: blue;">Data Model</span></b>, <b><span style="color: blue;">Variables</span></b>, or <span style="color: blue;"><b>Roles </b></span>menu (see Figure 2).</li>
<ul>
<li><i>Action menus</i> contain actions that are relevant for a particular object or context, and are visible when the object is selected.</li>
<li>For example, if a source object in the Database menu is selected, its action menu shows: <i>Add to Model</i>, <i>Inspect</i>, and <i>Duplicate </i>(see Figure 3).</li>
</ul>
</ul>
<li><b>Add source tables</b> or views to the model and <b>classify</b> them as either a <a href="https://en.wikipedia.org/wiki/Fact_table" target="_blank">fact table</a> or
a <a href="https://en.wikipedia.org/wiki/Dimension_(data_warehouse)#Dimension_table" target="_blank">dimension table</a>. </li>
<ul>
<li>After you have started modeling data, the right pane in Data Modeler shows the <span style="color: blue;"><b>fact tables</b></span>, <span style="color: blue;"><b>dimension tables</b></span>, and <span style="color: blue;"><b>joins </b></span>(see Figure 4)</li>
<ul>
<li>The right pane in Data Modeler is a <u>contextual pane</u> that changes depending on what task you’re performing. </li>
</ul>
</ul>
<li><b>Define joins</b> between fact and dimension tables </li>
<li><b>Ensure Correct Mapping </b></li>
<ul>
<li>Every dimension table maps to at least one fact table, and that every
fact table maps to at least one dimension table. </li>
</ul>
<li><b>Edit object with its editor</b></li>
<ul>
<li>Specify <b><span style="color: blue;">aggregation </span>rules</b> for different fact columns</li>
<li>Create <span style="color: blue;"><b>derived measures</b></span>
based on expressions</li>
<li>Create <span style="color: blue;"><b>dimension hierarchies</b></span> to support drilling</li>
<ul>
<li>See video 3</li>
</ul>
<li>Create
<span style="color: blue;"><b>level-based measures</b></span>. </li>
</ul>
<li><b>Publish </b><b>data model</b> </li>
<ul>
<li>To permanently save the changes and make the data
available for use in analyses</li>
<ul>
<li>When your HTTP <u>browser session times out</u> (after 20 minutes of inactivity), the lock is released and any unpublished changes are discarded.</li>
<li>Similarly, <u>closing a browser</u> ends the HTTP session and discards any unpublished changes. </li>
</ul>
</ul>
</ul>
<div>
<div class="separator" style="clear: both; text-align: center;">
</div>
</div>
<div class="separator" style="clear: both; text-align: center;">
</div>
<h3>
</h3>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjTmxt7UIY2yDLzTtSkCCRVXpbqhnV0jr2ttODyvA9JUSeMeM1vuIkCUxjRUCjxKzHama-32V3UK7U4D8uV1fuAunQMvacheIz5AQcGveJxREe7SfnKxiC_0cEsfS6bhbHZ8mb1FNKQ_ZDB/s1600/OracleAnalyticsCloud.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="263" data-original-width="1024" height="144" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjTmxt7UIY2yDLzTtSkCCRVXpbqhnV0jr2ttODyvA9JUSeMeM1vuIkCUxjRUCjxKzHama-32V3UK7U4D8uV1fuAunQMvacheIz5AQcGveJxREe7SfnKxiC_0cEsfS6bhbHZ8mb1FNKQ_ZDB/s640/OracleAnalyticsCloud.jpg" width="560" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 5. Create project in Oracle Analytics Cloud to use newly published data model (see video 1&2)</b></td></tr>
</tbody></table>
<br />
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEigC0Jiu2mzBMEjNxmWexB-HN47byxdJeSLbyNINNKh4uGFqkinWZcCUavxALSkTWUh-YbUhVRMFBG7PPsuGbzqcxFi9VXcv1-5EoTYldTlluRpZXnb48sbNJPM72YlbJhUF2dOFTyBIA8T/s1600/OAC_Add_Data_Set.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="309" data-original-width="560" height="220" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEigC0Jiu2mzBMEjNxmWexB-HN47byxdJeSLbyNINNKh4uGFqkinWZcCUavxALSkTWUh-YbUhVRMFBG7PPsuGbzqcxFi9VXcv1-5EoTYldTlluRpZXnb48sbNJPM72YlbJhUF2dOFTyBIA8T/s400/OAC_Add_Data_Set.jpg" width="400" /></a></td></tr>
<tr><td class="tr-caption"><b><span style="font-family: inherit; font-size: x-small;">Figure 6. Published <i>Cust Rev Model</i> displayed as a Subject Area</span></b></td></tr>
</tbody></table>
<div>
</div>
<div style="text-align: center;">
<br /></div>
<h3>
</h3>
<h3>
Visualizations / Dashboards / Analyses</h3>
<br />
After publishing your data model, you can start visualizing your data from your
enterprise reporting Home page (see Figure 5 and watch <a href="https://youtu.be/UdqDLaUB-IQ?t=163" target="_blank">video 1</a>). Your data model displays as a subject area that you
can use in visualizations, dashboards, and analyses (see Figure 6). The name of the subject area
matches the name of your data model.<br />
<br />
When you model source objects with multiple star relationships, they’re all part of the
same data model and are included in the same subject area. </div>
<div>
<br /></div>
<div>
<br />
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/SEdQCnKE-Bk/0.jpg" frameborder="0" height="266" src="https://www.youtube.com/embed/SEdQCnKE-Bk?feature=player_embedded" width="320"></iframe></div>
<div class="separator" style="clear: both; text-align: center;">
<b><span style="font-family: inherit; font-size: x-small;">Video 4. <span color="var(--ytd-video-primary-info-renderer-title-color, var(--yt-spec-text-primary))">Manage What Users Can See and Do in Oracle Analytics Cloud</span></span></b></div>
<div class="separator" style="clear: both; text-align: center;">
<b><span style="font-family: inherit; font-size: x-small;"><span color="var(--ytd-video-primary-info-renderer-title-color, var(--yt-spec-text-primary))" style="background-color: white;"><br /></span></span></b></div>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh2JoabVxVspm_SCGirx6287NSeD9TiMbyYiGu5duoaaSKVXrs9G7kEMjLLlnXIumUC6OPCOsoqK5Bk6kMc-4lpp8N_dzonq0RGKCmR1A36LCxdYjUh0IewVZ2FDxgXrjwJ3f0LJJ6PNsxa/s1600/OAC_Console.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="262" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh2JoabVxVspm_SCGirx6287NSeD9TiMbyYiGu5duoaaSKVXrs9G7kEMjLLlnXIumUC6OPCOsoqK5Bk6kMc-4lpp8N_dzonq0RGKCmR1A36LCxdYjUh0IewVZ2FDxgXrjwJ3f0LJJ6PNsxa/s1600/OAC_Console.jpg" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b style="font-size: medium;"><span style="font-size: x-small;">Figure 7. Use Console to create and manage application roles</span></b></td></tr>
</tbody></table>
<div class="separator" style="clear: both; text-align: center;">
<br /></div>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjwgjXdI9qj3zqqRyfNSbyek4Aw22XK1QSuX0xEdbjFS9p9n337Xkv0qeFenz9X6KOCfPMat8dEkVto8S5k3yZN5Mj4EY5bbfRxH2A94OvzL5tXOU-rSWk41FRV1JkvPhztz4yTsM5xAOaz/s1600/Admin_Users_and_Roles.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="503" data-original-width="560" height="358" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjwgjXdI9qj3zqqRyfNSbyek4Aw22XK1QSuX0xEdbjFS9p9n337Xkv0qeFenz9X6KOCfPMat8dEkVto8S5k3yZN5Mj4EY5bbfRxH2A94OvzL5tXOU-rSWk41FRV1JkvPhztz4yTsM5xAOaz/s400/Admin_Users_and_Roles.jpg" width="400" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><span style="font-size: x-small;"><b>Figure 8. Configure application roles from the <span style="text-align: start;">Administer Users and Roles</span><span style="text-align: start;"> page in the Console</span></b></span></td></tr>
</tbody></table>
<div class="separator" style="clear: both; text-align: center;">
<br /></div>
<div class="separator" style="clear: both; text-align: center;">
<b><span style="font-family: inherit; font-size: x-small;"><span color="var(--ytd-video-primary-info-renderer-title-color, var(--yt-spec-text-primary))" style="background-color: white;"></span></span></b></div>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg5Q6eADqcv7v9DxKY1jfuKpQI-Pn3Kx2HS4bHu-XwBmvAsOh8WkkuTKiJj7S36MKNBVU4IV0p9iGxO7aUyQ2n-RgPftDV_tUwBQCvlTlhvhAyIfy10GPMem-mdlqwLvcIQUJ1MIR02TIa4/s1600/OAC_AppRole_Mgmt.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="237" data-original-width="768" height="172" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg5Q6eADqcv7v9DxKY1jfuKpQI-Pn3Kx2HS4bHu-XwBmvAsOh8WkkuTKiJj7S36MKNBVU4IV0p9iGxO7aUyQ2n-RgPftDV_tUwBQCvlTlhvhAyIfy10GPMem-mdlqwLvcIQUJ1MIR02TIa4/s640/OAC_AppRole_Mgmt.jpg" width="560" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b><span style="font-family: inherit;">Figure 9. Application Roles tab shows predefined and custom application roles</span></b><br />
<b><br /></b></td></tr>
</tbody></table>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg8uuMeRZeb40l60rpDgp0wDIYgFuDI0fMU5QT5exlnl6a2GAtChjq20IkB0wB9oaUaJdkWGjmWqOGDHcPQmtDFDuvkpoXunqlDPJRFJ0ArWMMN-ajOSzPn6CCWt8CSZ5tcufd19FVXS7_o/s1600/OAC_Manager_Members.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="370" data-original-width="379" height="390" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg8uuMeRZeb40l60rpDgp0wDIYgFuDI0fMU5QT5exlnl6a2GAtChjq20IkB0wB9oaUaJdkWGjmWqOGDHcPQmtDFDuvkpoXunqlDPJRFJ0ArWMMN-ajOSzPn6CCWt8CSZ5tcufd19FVXS7_o/s400/OAC_Manager_Members.jpg" width="400" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 10. Add new members or remove members from an application role</b></td></tr>
</tbody></table>
<br /></div>
<h3>
Application Roles</h3>
<br />
You must have the <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/application-roles.html#GUID-3CEED4DB-F124-45AF-A115-75AF7392974C" target="_blank">BI Data Model Author role</a> (including table access permissions) to author data models.<br />
<br />
<table border="1" cellpadding="4" cellspacing="0" class="Formal" frame="hsides" rules="rows" style="background-color: white; border-collapse: collapse; border-spacing: 0px; box-sizing: border-box; color: #333333; font-family: "Helvetica Neue", "Segoe UI", Roboto, sans-serif-regular, sans-serif; font-size: 14px; min-width: 420px; table-layout: fixed; width: 100%px;" summary="This table describes predefined roles for Oracle Analytics Cloud" title=""><thead style="box-sizing: border-box;">
<tr align="left" style="box-sizing: border-box;" valign="top"><th align="left" id="d33623e113" style="background: rgb(63, 63, 63); border-bottom-style: none; border-top-style: none; box-sizing: border-box; color: white; overflow-wrap: break-word; padding: 3pt; text-align: left;" valign="bottom" width="29%"><span style="font-family: inherit; font-size: x-small;">Predefined Application Roles in Oracle Analytics Cloud</span></th><th align="left" id="d33623e115" style="background: rgb(63, 63, 63); border-bottom-style: none; border-top-style: none; box-sizing: border-box; color: white; overflow-wrap: break-word; padding: 3pt; text-align: left;" valign="bottom" width="27%"><span style="font-family: inherit; font-size: x-small;">Description</span></th><th align="left" id="d33623e117" style="background: rgb(63, 63, 63); border-bottom-style: none; border-top-style: none; box-sizing: border-box; color: white; overflow-wrap: break-word; padding: 3pt; text-align: left;" valign="bottom" width="22%"><span style="font-family: inherit; font-size: x-small;">Default Members</span></th><th align="left" id="d33623e119" style="background: rgb(63, 63, 63); border-bottom-style: none; border-top-style: none; box-sizing: border-box; color: white; overflow-wrap: break-word; padding: 3pt; text-align: left;" valign="bottom" width="22%"><span style="font-family: inherit; font-size: x-small;">Predefined Application Role in Oracle Identity Cloud Service <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/application-roles.html#GUID-3CEED4DB-F124-45AF-A115-75AF7392974C__FN-133225141-AD8C52E5" id="GUID-3CEED4DB-F124-45AF-A115-75AF7392974C__FN-133225141-AD8C52E5" name="GUID-3CEED4DB-F124-45AF-A115-75AF7392974C__FN-133225141-AD8C52E5" style="background-color: transparent; box-sizing: border-box; color: white;"><span style="box-sizing: border-box; line-height: 0; position: relative; top: -0.5em; vertical-align: baseline;">Foot 1</span></a></span></th></tr>
</thead><tbody style="box-sizing: border-box;">
<tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d33623e125" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="29%"><div style="box-sizing: border-box;">
<span style="font-family: inherit; font-size: x-small;">BI Service Administrator</span></div>
</td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="27%"><div style="box-sizing: border-box;">
<span style="font-family: inherit; font-size: x-small;">Allows users to administer <span style="box-sizing: border-box;">Oracle Analytics Cloud</span> and delegate privileges to others using the Console.</span></div>
</td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="22%"><div style="box-sizing: border-box;">
<span style="font-family: inherit; font-size: x-small;">Administrator who created the service</span></div>
</td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="22%"><span style="font-family: inherit; font-size: x-small;">ServiceAdministrator</span></td></tr>
<tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d33623e140" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="29%"><div style="box-sizing: border-box;">
<span style="background-color: yellow; font-family: inherit; font-size: x-small;">BI Data Model Author</span></div>
</td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="27%"><div style="box-sizing: border-box;">
<span style="font-family: inherit; font-size: x-small;">Allows users to manage data models in <span style="box-sizing: border-box;">Oracle Analytics Cloud</span>using <span style="box-sizing: border-box;">Data Modeler</span></span></div>
</td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="22%"><div style="box-sizing: border-box;">
<span style="font-family: inherit; font-size: x-small;">BI ServiceAdministrator</span></div>
</td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="22%"><span style="font-family: inherit; font-size: x-small;">ServiceAdministrator</span></td></tr>
</tbody></table>
</div>
<div>
<div class="props_rev_3" style="box-sizing: border-box;">
<span style="font-family: inherit; font-size: x-small;"><a href="https://www.blogger.com/null" id="GUID-1B4F7F46-C763-4B82-8FA9-F2E5A87F59D8" name="GUID-1B4F7F46-C763-4B82-8FA9-F2E5A87F59D8" style="-webkit-text-stroke-width: 0px; background-color: white; box-sizing: border-box; color: #226aa8; font-style: normal; font-variant-caps: normal; font-variant-ligatures: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-decoration: none; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px;"></a></span></div>
<br />
<div class="props_rev_3" style="box-sizing: border-box;">
<div style="box-sizing: border-box;">
Administrators configure what users see and do in <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/index.html" target="_blank">Oracle Analytics Cloud</a> from the <b>Administer Users and Roles</b> page in the Console (see Figure 7&8). This page presents user information in 3 different views:</div>
<div style="box-sizing: border-box;">
<br />
<div class="tblformal" id="GUID-BB3995C9-F089-483F-98BA-3018318001B0__GUID-B96B8CAF-6892-4A61-BD89-AE5A02A2950B" style="box-sizing: border-box;">
<div class="table-responsive" style="box-sizing: border-box; min-height: 0.01%; overflow-x: auto;">
<table border="1" cellpadding="4" cellspacing="0" class="Formal" frame="hsides" rules="rows" style="background-color: transparent; border-collapse: collapse; border-spacing: 0px; box-sizing: border-box; min-width: 420px; table-layout: fixed; width: 100%px;" summary="This table describes tabs on the Application Role Management page" title=""><thead style="box-sizing: border-box;">
<tr align="left" style="box-sizing: border-box;" valign="top"><th align="left" id="d34500e132" style="background: rgb(63, 63, 63); border-bottom-style: none; border-top-style: none; box-sizing: border-box; color: white; overflow-wrap: break-word; padding: 3pt; text-align: left;" valign="bottom" width="28%">Users and Roles Page</th><th align="left" id="d34500e134" style="background: rgb(63, 63, 63); border-bottom-style: none; border-top-style: none; box-sizing: border-box; color: white; overflow-wrap: break-word; padding: 3pt; text-align: left;" valign="bottom" width="72%">Description</th></tr>
</thead><tbody style="box-sizing: border-box;">
<tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d34500e138" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="28%"><div style="box-sizing: border-box; margin: 0px;">
Users tab</div>
</td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="72%"><div style="box-sizing: border-box; margin: 0px 0px 14px;">
Shows users from the identity domain associated with your service.</div>
<div style="box-sizing: border-box; margin: 14px 0px 0px;">
You can add users, delete users, and assign users one or more application roles in <span style="box-sizing: border-box;">Oracle Analytics Cloud</span>.</div>
</td></tr>
<tr align="left" style="border-bottom: 1px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d34500e150" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="28%"><div style="box-sizing: border-box; margin: 0px;">
Roles tab</div>
</td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="72%"><div style="box-sizing: border-box; margin: 0px 0px 14px;">
Shows roles from the identity domain associated with your service.</div>
<div style="box-sizing: border-box; margin: 14px 0px;">
You can add and remove roles (groups of users), and assign them to one or more application roles in <span style="box-sizing: border-box;">Oracle Analytics Cloud</span>.</div>
<div style="box-sizing: border-box; margin: 14px 0px 0px;">
From the Roles tab you can also see who belongs to each role.</div>
</td></tr>
<tr align="left" style="border-bottom: 2px solid rgb(63, 63, 63); box-sizing: border-box; padding: 8px 6px; vertical-align: top;" valign="top"><td align="left" id="d34500e164" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="28%"><div style="box-sizing: border-box; margin: 0px;">
Application Roles tab</div>
</td><td align="left" style="box-sizing: border-box; overflow-wrap: break-word; padding: 8px;" valign="top" width="72%"><div style="box-sizing: border-box; margin: 0px 0px 14px;">
Shows predefined application roles for <span style="box-sizing: border-box;">Oracle Analytics Cloud</span> together with any custom application roles you define.</div>
<div style="box-sizing: border-box; margin: 14px 0px 0px;">
From the Application Roles tab you can assign application roles to multiple users, roles, and other application roles. You can also create application roles of your own and assign privileges to them through other application roles.</div>
</td></tr>
</tbody></table>
</div>
</div>
</div>
</div>
<div>
<br />
You select members for an <a href="https://xmlandmore.blogspot.com/2019/02/oacgetting-started-with-oracle.html#ApplicationRoles" target="_blank">application role</a> or change parent privileges using the Console.<br />
<ol>
<li>Click <b>Console </b>(see Figure 7).</li>
<li>Click <b>Service Administration</b>, and then click <b>Administer Users and Roles</b> (see Figure 8).</li>
<li>Click the <b>Application Roles</b> tab (see Figure 9).</li>
<li>To display all available application roles, leave the <b>Search</b> field blank and <b>Show Members: All</b>. To filter the list by name, enter all or part of an application role name in the <b>Search</b> filter and press Enter. The search is case-insensitive, and searches both name and display name.</li>
<li>Look in the <b>Members</b> area to see who belongs to each application role:</li>
<ul>
<li>The number of <a href="https://xmlandmore.blogspot.com/2019/02/oacgetting-started-with-oracle.html#UsersAndRoles" target="_blank">users, roles, and application roles</a> that are members displays on the page. Click a number, such as <b>5</b> in this image, to see those members in more detail (either users, roles or application roles).</li>
</ul>
<li>To add new members or remove members from an application role (see Figure 10):</li>
<ol>
<li>Click <b>Members</b>.</li>
<li>Select either users, roles, or application roles from the <b>Type </b>box and click <b>Search </b>to show the current members.</li>
<li>Use the shuttle controls to move members between the <b>Available </b>and <b>All Selected</b> list.</li>
<ul>
<li>Some application roles aren't eligible to be members and these are grayed. For example, you can’t select a parent application role to be a member.</li>
</ul>
<li>Click OK.</li>
</ol>
<li>To see whether an application role, such as Sales Analyst, inherits privileges from other application roles:</li>
<ol>
<li>Click the action menu.</li>
<li>Select Manage Application Roles.</li>
<ul>
<li>Inherited privileges are displayed in the <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/configure-what-users-can-see-and-do.html#GUID-644002D1-E408-474A-8351-0210FCE90399" target="_blank">Selected Application Roles</a> pane. (see Figure 11)</li>
</ul>
</ol>
<li>To add or remove privileges:</li>
<ol>
<li>Click <b>Search </b>to display all available application roles.</li>
<ul>
<li>Alternatively, enter all or part of an application role name and click <b>Search</b>.</li>
</ul>
<li>Use the shuttle controls to move application roles between the <b>Available Application Roles</b> list and the <b>Selected Application Roles</b> list.</li>
<ul>
<li>You can’t select application roles that are grayed out. Application roles are grayed out so you can’t create a circular membership tree.</li>
</ul>
<li>Click OK.</li>
</ol>
</ol>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhoE5LybYWVJ6SQIF4UJC8tWa3JeFehXuQSgsDHSld5BQlDWoqPzYygJ2hvdxu9cXREz_x-yIm3Z9z29Kf1gttOj6XWa20LYKZ60JlSNO455E9bRMGiZNFQAyZJ0MEyKCrSJazYhYsJu_-y/s1600/SelectedApplicationRolesPane.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="193" data-original-width="418" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhoE5LybYWVJ6SQIF4UJC8tWa3JeFehXuQSgsDHSld5BQlDWoqPzYygJ2hvdxu9cXREz_x-yIm3Z9z29Kf1gttOj6XWa20LYKZ60JlSNO455E9bRMGiZNFQAyZJ0MEyKCrSJazYhYsJu_-y/s1600/SelectedApplicationRolesPane.jpg" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 11. User <i>Ed Ferguson</i> was assigned with the <i>Sales Analysts</i> application role</b></td></tr>
</tbody></table>
<br /></div>
<h3>
References</h3>
<ol>
<li><a href="http://xmlandmore.blogspot.com/2019/02/oacknowing-dimensional-modelling-basics.html" target="_blank">OAC―Knowing the Dimensional Modelling Basics (1/2)</a></li>
<li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/model-data-for-reports.html" target="_blank">Model Data for Reports</a> (OAC)</li>
<li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/use-data-modeler.html#GUID-20C65028-74E0-4041-8877-035DC224F0EC" target="_blank">Use Data Modeler</a> (OAC)</li>
<li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/preparing-data-oracle-analytics-cloud.pdf" target="_blank">Oracle® CloudPreparing Data in Oracle Analytics Cloud</a></li>
<li><a href="http://xmlandmore.blogspot.com/2019/02/oacknowing-machine-learning-basics.html" target="_blank">OAC―Knowing Machine Learning Basics</a></li>
<li>Data Visualization (<a href="https://community.oracle.com/community/groundbreakers/business_intelligence/data-visualization">Forum</a>)</li>
<li><a href="https://docs.oracle.com/en/middleware/bi/data-visualization-desktop/index.html">Oracle Data Visualization Desktop</a> (Documentation)</li>
<li><a href="http://xmlandmore.blogspot.com/2019/02/oacloading-data-with-data-sync.html" target="_blank">OAC―Loading Data with Data Sync</a></li>
<li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/edit-hierarchies-and-levels.html#GUID-C02004DD-C42D-4BB2-A505-0E817091019A" target="_blank">Edit Hierarchies and Levels</a> (OAC Data Modeler)</li>
<li><a href="https://www.youtube.com/watch?v=S8fTMLQ4B-U" target="_blank">Get Started with Oracle Data Visualization V5</a> (<span style="background-color: yellow;">YouTube</span>)</li>
<li><a href="https://www.youtube.com/watch?v=mBzi7KntKdM" target="_blank">Explore Data in Oracle Data Visualization V5</a> (<span style="background-color: yellow;">YouTube</span>)</li>
<li><a href="https://www.youtube.com/embed/ti7DtkTlGVo" target="_blank">Create Data Flows in Oracle Data Visualization V5</a> (<span style="background-color: yellow;">YouTube</span>)</li>
<li><a href="https://www.safaribooksonline.com/library/view/data-science-for/9781449374273/" target="_blank">Data Science for Business</a> (Safari)</li>
<li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/upload-data-models-oracle-bi-enterprise-edition.html#GUID-2BEB60F6-986D-4A7A-9D63-EEE67083E98A" target="_blank">Upload Data Models from Oracle BI Enterprise Edition</a></li>
<li><a href="https://blogs.oracle.com/analyticscloud/learn-modern-data-visualization-with-oracle-analytics" target="_blank">Learn Modern Data Visualization with Oracle Analytics</a></li><li>Click <a href="https://www.oracle.com/business-analytics/" target="_blank">here</a> for more A-Team Oracle Analytics (OAC) Blogs.</li>
</ol>
<br />
<br />
<br /></div></div>
Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com188tag:blogger.com,1999:blog-748094882401183761.post-66373440099487294032019-02-17T11:15:00.003-06:002021-07-30T10:00:46.201-05:00OAC―Knowing the Dimensional Modelling Basics (1/2)<div dir="ltr" style="text-align: left;" trbidi="on">
<meta content="width=device-width, initial-scale=1" name="viewport"></meta><div class="separator" style="clear: both; text-align: center;"><iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen="" frameborder="0" height="315" src="https://www.youtube.com/embed/ajVfBJrTOxw" title="YouTube video player" width="560"></iframe></div>
<div class="separator" style="clear: both; text-align: center;">
<span><b>Video 1. </b>Dimensional Modeling – Declaring Dimensions (YouTube <a href="https://www.youtube.com/watch?v=ajVfBJrTOxw" target="_blank">link</a>)</span></div>
<div class="separator" style="clear: both; text-align: center;">
<b><span style="font-size: x-small;"><br /></span></b></div>
<h3>
</h3>
<h3>
Operational Processing vs Data Warehousing</h3>
<div dir="ltr" trbidi="on">
<br />
One of the most important assets of any organization is its information. This asset is almost always used for two purposes:<sup>[1]</sup></div>
<div dir="ltr" trbidi="on">
<div>
<br />
<br />
<table border="1" cellpadding="2" cellspacing="2" style="width: 70%px;">
<tbody>
<tr>
<td bgcolor="#993300" valign="top"><br /></td>
<td bgcolor="#993300" valign="top"><span style="color: white;"><b>Operational Processing</b></span></td>
<td bgcolor="#993300" valign="top"><span style="color: white;"><b>Analytical Decision Making</b></span></td>
</tr>
<tr>
<td valign="top"><b>Flavor</b><b><br />
</b></td>
<td valign="top">Transaction<u>al</u></td>
<td valign="top">Analytical</td>
</tr>
<tr>
<td valign="top"><b>Main Data Flow</b><b><br />
</b></td>
<td valign="top">The operational systems are where you put data in </td>
<td valign="top">The <a href="https://en.wikipedia.org/wiki/Data_warehouse" target="_blank">Data Warehousing</a> and <a href="https://en.wikipedia.org/wiki/Business_intelligence" target="_blank">Business Intelligence</a> (<b>DW/BI</b>) systems are where you get the data out</td>
</tr>
<tr>
<td valign="top"><b>Optimization</b><b><br />
</b></td>
<td valign="top">Optimized to process transactions quickly</td>
<td valign="top">Optimized for high-performance queries</td>
</tr>
<tr>
<td valign="top"><b># of Transactions in Processing</b><b><br />
</b></td>
<td valign="top">Almost always deal with one transaction record at a time</td>
<td valign="top">Often require that many transactions be searched and compressed into an answer set</td>
</tr>
<tr>
<td valign="top"><b>History Preservation</b><b><br />
</b></td>
<td valign="top">Typically do not maintain history, but rather update data to reflect the most current state</td>
<td valign="top">Typically demand that historical context be preserved to accurately evaluate the organization's performance over time</td>
</tr>
</tbody>
</table>
<br />
<br /></div>
<h3>
</h3>
<h3>
Dimensional Modeling<span style="font-weight: normal;"> (DW/BI)</span></h3>
<br />
<a href="https://en.wikipedia.org/wiki/Dimensional_modeling" target="_blank">Dimensional modeling</a> is one of the methods of <a href="https://en.wikipedia.org/wiki/Data_modeling" target="_blank">data modeling</a>, that is the preferred technique for presenting <a href="https://en.wikipedia.org/wiki/Analytics" target="_blank">analytic data</a>. It helps us store the data in such a way that it is relatively easy to retrieve the data from the data once the data is stored in database.<br />
<br />
This is the reason why dimensional modeling is <b><span style="color: blue;">used mostly in <a href="https://en.wikipedia.org/wiki/Data_warehouse" target="_blank">data warehouses</a></span></b> built for reporting. On the other side, dimensional model is not a good solution if your primary purpose of your data modeling is to reduce storage space requirement, reduce redundancy, speed-up loading time etc.<sup>[1]</sup><br />
<br />
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjOi8Qx8sSkeqtcdrcpw2xe_xPcbuSo41vaDtYqXkf0i7LTscdEjdeds73_AGePyXZRCBEGFKzIM0ynCaotdrsAdZqUXguaScN1LIjm7a0emAkEo8dpEL2HDHF2Vrms4aYCnZjuCJpJTFSt/s1600/star_cube.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="221" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjOi8Qx8sSkeqtcdrcpw2xe_xPcbuSo41vaDtYqXkf0i7LTscdEjdeds73_AGePyXZRCBEGFKzIM0ynCaotdrsAdZqUXguaScN1LIjm7a0emAkEo8dpEL2HDHF2Vrms4aYCnZjuCJpJTFSt/s1600/star_cube.jpg" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 1. Star Schema (left) vs OLAP Cube (right)</b></td></tr>
</tbody></table>
<br />
<h3>
3NF Model vs Dimensional Model</h3>
</div>
<div dir="ltr" trbidi="on">
<br /></div>
Although dimensional models are often instantiated in <a href="https://en.wikipedia.org/wiki/Relational_database_management_system" target="_blank">relational database management systems</a> (<b>RDMS</b>), they are quite different from <a href="https://en.wikipedia.org/wiki/Third_normal_form" target="_blank">third normal form</a> (<b>3NF</b>) models which seek to remove data redundancies:<br />
<div>
<ul>
<li><b>3NF Model (</b>or <a href="https://en.wikipedia.org/wiki/Database_normalization" target="_blank">Normalized Model</a><b>)</b></li>
<ul>
<li>Divides data into many discrete <b><span style="color: blue;">entities</span></b>, each of which becomes a relational table</li>
<li>Sometimes are referred as <a href="https://en.wikipedia.org/wiki/Entity%E2%80%93relationship_model" target="_blank">entity-relationship</a> (<b>ER</b>) models</li>
<ul>
<li><a href="https://en.wikipedia.org/wiki/Entity%E2%80%93relationship_model" target="_blank">Entity-relationship diagrams</a> (ER diagrams or <b>ERD</b>s) are drawings that communicate the relationships between tables</li>
</ul>
<li>Designed to reduce the duplication of data and ensure <a href="https://en.wikipedia.org/wiki/Referential_integrity">referential integrity</a></li>
<li>Designed to improve database processing while <u>minimizing storage costs</u></li>
<li><b><span style="color: blue;">Useful in operational processing</span></b> because an update or insert transaction touches the database in only one place</li>
<ul>
<li>However, are too complicated for BI queries. </li>
</ul>
</ul>
<li><b>Dimensional Model</b> (<a href="https://en.wikipedia.org/wiki/Star_schema" target="_blank">Star Schemas</a> and <a href="https://en.wikipedia.org/wiki/OLAP_cube" target="_blank">OLAP Cubes</a>)</li>
<ul>
<li>Both stars and cubes have a <u>common logical design</u> with recognizable dimensions; however, the physical implementation differs (see Figure 1):</li>
<ul>
<li>Star Schemas</li>
<ul>
<li>Referred to as s<b><a href="https://en.wikipedia.org/wiki/Star_schema" target="_blank">tar schemas</a></b> in RDBS because of their resemblance to a star-like structure in RDMS implementation</li>
</ul>
<li>OLAP Cubes</li>
<ul>
<li>Referred to as <a href="https://en.wikipedia.org/wiki/Online_analytical_processing" target="_blank">online analytical processing</a> (OLAP) cubes in multidimensional database platform</li>
<li>Cubes can deliver superior query performance because of the <u>precalculations, indexing strategies, and other optimizations</u></li>
<li>The downside is that you pay a load performance price for these capabilities, especially with large data sets</li>
</ul>
</ul>
<li>Contains the same information as a normalized model, but packages the data in a format that <u>delivers user understandability, query performance, and resilience to change</u></li>
</ul>
</ul>
<div>
<div dir="ltr" trbidi="on">
Both 3NF and dimensional models can be represented in ERDs because both consist of joined relational tables; the <u>key difference between 3NF and dimensional models</u> is the <b><span style="color: blue;">degree of normalization</span></b>.</div>
<div dir="ltr" trbidi="on">
<br /></div>
<div dir="ltr" trbidi="on">
Although the capabilities of OLAP technology are continuously improving, we generally recommend that detailed, atomic information be loaded into a star schema; optional OLAP cubes are then populated from the star schema.<sup>[1]</sup></div>
<br />
<h3>
Dimensional Modeling Case Study</h3>
<br />
<div dir="ltr" trbidi="on">
<div dir="ltr" style="text-align: left;" trbidi="on">
Consider the business scenario for a fast food chain:<sup>[2]</sup></div>
<blockquote class="tr_bq">
The business objective is to create a data model that can store and report number of burgers and fries sold from a specific McDonalds outlet per day. </blockquote>
<br />
Below are the steps used for dimensional modeling: </div>
<div dir="ltr" trbidi="on">
<ul>
<li><b>Identify the dimensions</b></li>
<ul>
<li><b>Dimensions </b></li>
<ul>
<li>Describe the “<span style="color: blue;"><b>who, what, where, when, how, and why</b></span>” associated with the business process measurement event (e.g. a sales transaction).</li>
</ul>
<li>In the above scenario, we have 3 dimensions - "food" (e.g. burgers and fries), "store" and "day"</li>
<ul>
<li>Separate <b><a href="https://en.wikipedia.org/wiki/Dimension_(data_warehouse)" target="_blank">dimension tables</a></b> are created for separate dimensions</li>
<ul>
<li>The <b><span style="color: blue;">dimension tables contain </span></b><b><span style="color: blue;">the textual context</span></b> (normally with set of <u>descriptive nouns that characterize the business process</u>) associated with a measurement event. </li>
</ul>
</ul>
</ul>
<li><b>Identify the measurement events</b> (or <span style="color: blue;"><b>facts</b></span>)</li>
<ul>
<li><b>Measurement Events</b></li>
<ul>
<li>A measurement event in the physical world has a one-to-one relationship to a single row in the corresponding fact table</li>
</ul>
<li>In the above scenario, we have 1 measurement event - "quantity"</li>
<ul>
<li>A <b><a href="https://en.wikipedia.org/wiki/Fact_table" target="_blank">fact table</a></b> is created for storing measures and foreign keys to the dimension tables</li>
<ul>
<li>The fact table stores the "number" of food sold in "Quantity" column against a given store, food and day columns. </li>
<li>These store/food/day columns are basically <a href="https://en.wikipedia.org/wiki/Foreign_key" target="_blank">foreign key</a> columns of the <a href="https://en.wikipedia.org/wiki/Unique_key" target="_blank">primary keys</a> in respective dimension tables. </li>
</ul>
</ul>
</ul>
<li><b>Identify the attributes or properties of dimensions</b></li>
<ul>
<li>Attributes (or Properties)</li>
<ul>
<li>Each dimension might have number of different properties, but for a given context, not all of them are relevant for business</li>
</ul>
<li>Knowing the properties let us decide what columns are required to be created in each dimension table.</li>
<li>In the above scenario, we could have</li>
<ul>
<li><i>Food</i>: name (burgers or fries)</li>
<li><i>Store</i>: name, location, etc</li>
<li><i>Day</i>: date</li>
</ul>
</ul>
<li><b>Identify the granularity of the measures</b></li>
<ul>
<li>All the measurement rows in a fact table must be at the same grain (i.e., day or month). </li>
<li>Having the discipline to create fact tables with a single level of detail ensures that measurements <span style="color: blue;"><b>aren't</b></span> inappropriately <span style="color: blue;"><b>double-counted</b></span>.</li>
</ul>
<li><b>History Preservation</b> (Optional)</li>
<ul>
<li>Identify which dimensions are <a href="https://www.oracle.com/webfolder/technetwork/tutorials/obe/db/10g/r2/owb/owb10gr2_gs/owb/lesson3/slowlychangingdimensions.htm" target="_blank">slowly changing</a> (or fast changing or unchanging) is the last and final step of modeling (see video 1)</li>
<li>There are 8 different dimension types, but only 3 are commonly used:<sup>[3]</sup></li>
<ul>
<li>Type 0 - Fixed, non changing attribute</li>
<li>Type 1 - Changing attribute, no history kept</li>
<li>Type 2 - Most complex, keeps historical changes</li>
</ul>
</ul>
</ul>
</div>
<div dir="ltr" trbidi="on">
<br />
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEitJ-2fsJeX3X9C_CsGxKXb5Wo9EvYF9mIhlFywaNqivDA469jTG1yhZj8jWLZHopHm82kCzk3d8TbxQ88KctmWZvc-HL-Bw1NkmMzOB1KOKNkG_09qnMkbLCUqRKkPUawOsKQfGMscVRuH/s1600/Dimension_hiearchy.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="268" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEitJ-2fsJeX3X9C_CsGxKXb5Wo9EvYF9mIhlFywaNqivDA469jTG1yhZj8jWLZHopHm82kCzk3d8TbxQ88KctmWZvc-HL-Bw1NkmMzOB1KOKNkG_09qnMkbLCUqRKkPUawOsKQfGMscVRuH/s1600/Dimension_hiearchy.jpg" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 2. Sample rows from a dimension table with denormalized hierarchies</b></td></tr>
</tbody></table>
<br />
<h3>
Summary</h3>
<ul>
<li><b>Dimensional Model </b>(cf. Normalized Model )</li>
<ul>
<li>Dimensional schema is <b><span style="color: blue;">simpler and symmetric</span></b></li>
<ul>
<li>Business users benefit from the simplicity because the data is <u>easier to understand and navigate</u></li>
<li>Database optimizers process these simple schemas with fewer joins more efficiently</li>
<li>Every dimension is equivalent; all dimensions are symmetrically-equal entry points into the fact table.</li>
<ul>
</ul>
</ul>
<li>Dimensional models are gracefully <span style="color: blue;"><b>extensible to accommodate change</b></span></li>
<ul>
<li>With dimensional models, you can add completely new dimensions to the schema as long as a single value of that dimension is defined for each existing fact row.</li>
<ul>
</ul>
</ul>
</ul>
<li><b>Fact Tables</b></li>
<ul>
<li>Fact tables tend to be <u>deep in terms of the number of rows</u>, but <u>narrow in terms of the number of columns</u></li>
<li>The most useful facts are <span style="color: blue;"><b>numeric </b></span>and <b><span style="color: blue;">additive</span></b>, such as dollar sales amount. </li>
<ul>
<li><b><span style="color: blue;">Additivity </span></b>is crucial because BI applications rarely retrieve a single fact table row.</li>
<ul>
<li>However, you will see that facts are sometimes semi-additive (e.g., account balances) or even non-additive (e.g., unit prices). </li>
</ul>
</ul>
<li>Facts are often described as <b><span style="color: blue;">continuously valued</span></b> </li>
<li><u>Fact tables</u> usually <u>make up <span style="color: blue;"><b>90 percent or more</b></span> of the total space</u> consumed by a dimensional model. </li>
<li>All fact tables have two or more foreign keys that connect to the dimension tables' primary keys.</li>
<li>Fact tables (or <span style="color: blue;"><b>bridge table</b></span>) express <u>many-to-many relationships</u>. </li>
</ul>
<li><b>Dimension Tables</b></li>
<ul>
<li>Dimension tables tend to <u>be shallow in terms of the number of rows</u>, but <u>wide in terms of the number of columns</u></li>
<li>Each dimension is defined by a single primary key (<a href="https://en.wikipedia.org/wiki/Surrogate_key" target="_blank">surrogate key or natural key</a>) , which serves as the basis for <a href="https://en.wikipedia.org/wiki/Referential_integrity" target="_blank">referential integrity</a> with any given fact table to which it is joined.</li>
<li><b><span style="color: blue;">Robust d</span><span style="color: blue;">imension attributes</span></b> <u>deliver robust analytic slicing-and-dicing capabilities</u>.</li>
<ul>
<li>In many ways, <b><span style="color: blue;">the data warehouse is only as good as the dimension attributes</span></b>; the analytic power of the DW/BI environment is directly <u>proportional to the quality and depth of the dimension attributes</u>.</li>
<li>Dimension attributes serve as the primary source of <u>query constraints, groupings, and report labels</u>.</li>
<ul>
<li>You should strive to minimize the use of codes or cryptic abbreviations in dimension tables by replacing them with <u>more verbose textual attributes</u>.</li>
</ul>
</ul>
<li>Dimension tables often represent <b><span style="color: blue;">hierarchical relationships</span></b> (See Figure 2)</li>
<ul>
<li>For example, <i>products </i>roll up into <i>brands </i>and then into <i>categories</i>. </li>
<li>For each row in the <i>product </i>dimension, you should store the associated <i>brand </i>and <i>category </i>description. </li>
<li>The hierarchical descriptive information is stored redundantly in the spirit of ease of use and query performance.</li>
<li>You <b><span style="color: blue;">should resist the habitual urge to normalize data</span></b> (i.e., <a href="https://en.wikipedia.org/wiki/Snowflake_schema" target="_blank">snowflaking</a>)</li>
<ul>
<li>You <u>should almost always trade off dimension table space for simplicity and accessibility</u>.</li>
<li>Because dimension tables typically are geometrically smaller than fact tables, improving storage efficiency by normalizing or snowflaking has virtually no impact on the overall database size. </li>
<ul>
</ul>
</ul>
</ul>
</ul>
<li><b>Fact or Dimension Attribute</b></li>
<ul>
<li>When triaging operational source data, it is sometimes <u>unclear whether a numeric data element is a fact or dimension attribute</u>. It is</li>
<ul>
<li>A fact if</li>
<ul>
<li>The column is a measurement that takes on <u>lots of values and participates in calculations</u></li>
</ul>
<li>A dimension attribute if</li>
<ul>
<li>The column is a discretely valued description that is more or less constant and participates in constraints and row labels</li>
</ul>
<li>Note:</li>
<ul>
<li><u>Continuously valued numeric observations</u> are almost always facts; <u>discrete numeric observations drawn from a small list</u> are almost always dimension attributes.</li>
</ul>
</ul>
</ul>
</ul>
<h3>
References</h3>
<ol>
<li><a href="https://www.barnesandnoble.com/w/the-data-warehouse-toolkit-ralph-kimball/1121171999?ean=9780471200246" target="_blank">The Data Warehouse Toolkit: The Complete Guide to Dimensional Modeling</a></li>
<li><a href="https://dwbi.org/data-modelling/dimensional-model/1-dimensional-modeling-guide" target="_blank">What is dimensional modelling?</a></li>
<li><a href="https://www.youtube.com/watch?v=ajVfBJrTOxw" style="background-color: yellow;" target="_blank">Dimensional Modeling – Declaring Dimensions</a> (Youtube)</li>
<li><a href="https://blogs.oracle.com/analyticscloud/learn-modern-data-visualization-with-oracle-analytics" target="_blank">Learn Modern Data Visualization with Oracle Analytics</a></li><li>Click <a href="https://www.oracle.com/business-analytics/" target="_blank">here</a> for more A-Team Oracle Analytics (OAC) Blogs.</li>
</ol>
</div>
</div>
</div></div>
Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com35tag:blogger.com,1999:blog-748094882401183761.post-1895200914998251512019-02-15T12:01:00.002-06:002022-02-08T12:31:10.100-06:00Oracle Fusion Middleware Diagnostic Framework―How to Diagnosing Problems<div dir="ltr" style="text-align: left;" trbidi="on">
<a href="https://www.oracle.com/middleware/technologies/" target="_blank">Oracle Fusion Middleware</a> includes a <a href="https://docs.oracle.com/middleware/1213/core/ASADM/diagnostics.htm#ASADM11143" target="_blank">Diagnostic Framework</a>, which aids in detecting, diagnosing, and resolving problems. The problems that are targeted in particular are <span style="color: blue;"><b>critical errors</b></span>, such as those caused by <br />
<ul style="text-align: left;">
<li><b>Code bugs</b></li>
<li><b>Metadata corruption</b></li>
<li><b>Customer data corruption</b></li>
<li><b>Deadlocked threads</b></li>
<li><b>Inconsistent state</b></li>
</ul>
In this article, we will cover what <a href="https://docs.oracle.com/middleware/1213/core/ASADM/diagnostics.htm#ASADM11143" target="_blank">Oracle Fusion Middleware Diagnostic Framework</a> is and how it works.<br />
<div>
<br /></div>
<div>
<h3>
Problem vs Incident</h3>
<ul style="text-align: left;">
<li><b>Problem </b></li>
<ul>
<li>Is a <span style="color: blue;"><b>critical error</b></span></li>
<ul>
<li>Critical errors manifest as internal errors or other severe errors. Problems are tracked in the <a href="https://oracle-base.com/articles/11g/automatic-diagnostics-repository-11gr1" target="_blank">Automatic Diagnostic Repository</a> (<b>ADR</b>).</li>
</ul>
<li>Has a <b>problem key</b></li>
<ul>
<li>Is a text string that describes the problem</li>
<li>Includes an error code (in the format <span style="color: blue;"><b>XXX-nnnnn</b></span>) and in some cases, other error-specific values.</li>
<ul>
<li>incident <span style="color: red;"><b>1123</b></span> created with problem key "<b><span style="color: blue;">DFW-99998</span></b> [weblogic.jdbc.extensions.PoolDisabledSQLException][oracle.security.jps.internal.policystore.rdbms.JpsDBDataManager.executeBaseQuery][bi-contentstorage]"</li>
</ul>
</ul>
</ul>
<li><b>Incident</b></li>
<ul>
<li>Is a single occurrence of a problem</li>
<ul>
<li>When a problem (critical error) occurs multiple times, an incident is created for each occurrence. Incidents <u>are timestamped and tracked in the ADR</u></li>
</ul>
<li>Is identified by a numeric incident ID (see <b style="color: red;">1123</b> above), which is <u>unique within the <a href="https://oracle-base.com/articles/11g/automatic-diagnostics-repository-11gr1#setting-adr-location" target="_blank">ADR home</a></u></li>
</ul>
</ul>
</div>
<div>
<br />
<div>
<h3>
Oracle Fusion Middleware Diagnostic Framework </h3>
<br />
When a critical error occurs, it is assigned an incident number, and diagnostic data for the error (such as log files) are immediately captured and tagged with this number. The data is then stored in the <a href="https://oracle-base.com/articles/11g/automatic-diagnostics-repository-11gr1" target="_blank">Automatic Diagnostic Repository</a> (<b>ADR</b>), where it can later be retrieved by incident number and analyzed. Here is the summary of its features:</div>
<div>
<ul>
<li>Supports <b>incident detection log filter</b></li>
<ul>
<li>Implements the <b>java.util.logging</b> filter</li>
<li>Inspects each log message to see if an incident should be created, basing its decision on the <b><span style="color: blue;">diagnostic rules</span></b> for components and applications.</li>
</ul>
<li>Integrated with <a href="https://xmlandmore.blogspot.com/2012/12/understanding-incident-and-diagnostic.html" target="_blank">WebLogic Diagnostics Framework</a> (<b>WLDF</b>)</li>
<li>All <b>diagnostic data</b> relating to a <u>critical error </u>is captured and stored as an <b>incident </b>in <a href="https://oracle-base.com/articles/11g/automatic-diagnostics-repository-11gr1" target="_blank">Automatic Diagnostic Repository</a> (<b>ADR</b>)</li>
<ul>
<li><b>Collects diagnostic data</b>, such as</li>
</ul>
<ul><ul>
<li>Thread dumps, DMS metric dumps, and <a href="https://xmlandmore.blogspot.com/2012/12/understanding-incident-and-diagnostic.html" target="_blank">WebLogic Diagnostics Framework</a> (WLDF) server image dumps </li>
</ul>
</ul>
<li>Provides <b>standardized log formats</b></li>
<ul>
<li> Using the ODL log file format <u>across all Oracle Fusion Middleware components</u>.</li>
</ul>
<li><b>Incident flood control</b></li>
<ul>
<li>Diagnostic Framework applies flood control to incident generation after certain thresholds are reached</li>
<ul>
<li>To <u>avoid generating too much diagnostic data</u>, which would consume too much space in the ADR and could possibly slow down your efforts to diagnose and resolve the problem</li>
</ul>
<li>Example:</li>
[2019-02-08T23:59:50.082+00:00] [bi_server2] [WARNING] [DFW-40125] [oracle.dfw.incident] [tid: [ACTIVE].ExecuteThread: '62' for queue: 'weblogic.kernel.Default (self-tuning)'] [userId: <wls kernel="">] [ecid: 551d9654-1bc1-4b2f-b8d4-cbd3ab71603c-0004765a,0] [partition-name: DOMAIN] [tenant-name: GLOBAL] <b><span style="color: blue;">incident flood controlled</span></b> with Problem Key "DFW-99998 [weblogic.jdbc.extensions.PoolDisabledSQLException][oracle.security.jps.internal.policystore.rdbms.JpsDBDataManager.executeBaseQuery][bi-contentstorage]"</wls></ul>
<br />
</ul>
<h3>
Integration with WLDF</h3>
<div>
<br /></div>
<div>
Oracle Fusion Middleware Diagnostics Framework integrates with the following components of WLDF:</div>
<ul style="text-align: left;">
<li><b>WLDF Watch and Notification</b></li>
<ul>
<li>Watches specific logs and metrics for specified conditions and sends a notification when a condition is met. </li>
<ul>
<li>Oracle Fusion Middleware Diagnostics Framework integrates with the WLDF Watch and Notification component to create incidents.</li>
</ul>
<li>There are several types of notifications, including JMX notification and a notification to create a Diagnostic Image. </li>
</ul>
<li><b>Diagnostic Image Capture</b></li>
<ul>
<li>Gathers the most common sources of the <u>key server state</u> used in diagnosing problems. </li>
<ul>
<li>Packages that state into a single artifact, the <a href="https://docs.oracle.com/middleware/1213/core/ASADM/diagnostics.htm#ASADM11154" target="_blank">Diagnostic Image</a>. </li>
<li>With Oracle Fusion Middleware Diagnostics Framework, it writes the artifact to ADR.</li>
</ul>
</ul>
</ul>
Figure 1 shows the interaction when the incident is detected by the <span style="color: blue;"><b>incident log detector</b></span>. It shows the interaction among the incident log detector, the WLDF Diagnostic Image MBean, ADR, and component or application dumps when an incident is detected by the incident log detector.</div>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiOWmovQTEHWQyFxKyrgdulK1fUKxVxmLTHa9xogH_eNiV3EITEeDfFQ3wnycx6UKTreWI3QTYawQYgpHv5RFhHuyPZFo7s13J8c-O_WPnf1Aljflks4hx_fg7PK9MPfqCR4C5mSpXUo4qp/s1600/ODL_Incident_Creation.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="386" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiOWmovQTEHWQyFxKyrgdulK1fUKxVxmLTHa9xogH_eNiV3EITEeDfFQ3wnycx6UKTreWI3QTYawQYgpHv5RFhHuyPZFo7s13J8c-O_WPnf1Aljflks4hx_fg7PK9MPfqCR4C5mSpXUo4qp/s1600/ODL_Incident_Creation.jpg" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;">Figure 1. Incident Creation Generated by Incident Log Detector</td></tr>
</tbody></table>
<div>
<b><u>Sample WebLogic Server Log</u></b></div>
<div>
<br /></div>
<blockquote class="tr_bq">
<span style="font-size: x-small;"><Feb 8, 2019 11:59:54,143 PM UTC> <Notice> <Diagnostics> <xxxxxxx020308oacpod-bi-2.svcsbnet308.yyyyyyy2.oraclevcn.com> <bi_server2> <[STANDBY] ExecuteThread: '29' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <eed7eff4-508d-4c1d-9c2b-b19d8e8936a6-0007d1d0> <1549670394143> <[severity-value: 32] [rid: 0] [partition-id: 0] [partition-name: DOMAIN] > <BEA-320068> <Watch "UncheckedException" in module "Module-FMWDFW" with severity "Notice" on server "bi_server2" has triggered at Feb 8, 2019 11:59:54 PM UTC. Notification details:<br />WatchRuleType: Log<br /><span style="color: blue;"><b>WatchRule</b></span>: (log.severityString == 'Error') and ((log.messageId == 'WL-101020') or (log.messageId == 'WL-101017') or (log.messageId == 'WL-000802') or (log.messageId == 'BEA-101020') or (log.messageId == 'BEA-101017') or (log.messageId == 'BEA-000802'))<br />WatchData: MESSAGE = [ServletContext@879994790[app:bi-servicelcm-rest module:bi-servicelcm-rest path:null spec-version:3.1]] Root cause of ServletException.<br />oracle.bi.servicelcm_v2.exceptions.PersistenceBackendException: Unable to create Pod record<br /><span style="white-space: pre;"> </span>at oracle.bi.servicelcm_v2.db.DatabasePodPersistenceManager.getPodImpl(DatabasePodPersistenceManager.java:39) </span></blockquote>
<blockquote class="tr_bq">
<span style="font-size: large;">... </span></blockquote>
<blockquote class="tr_bq">
<span style="font-size: x-small;"><Feb 8, 2019 11:59:58,489 PM UTC> <Emergency> <oracle.dfw.incident> <</span><span style="font-size: x-small;">xxxxxxx</span><span style="font-size: x-small;">020308oacpod-bi-2.svcsbnet308.yyyyyyy2.oraclevcn.com> <bi_server2> <[ACTIVE] ExecuteThread: '68' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <eed7eff4-508d-4c1d-9c2b-b19d8e8936a6-0007d1d1> <1549670398489> <[severity-value: 1] [rid: 0] [partition-id: 0] [partition-name: DOMAIN] > <BEA-000000> <<span style="color: blue;"><b>incident 1326 created with problem key "DFW-99998</b></span> [weblogic.jdbc.extensions.PoolDisabledSQLException][oracle.bi.servicelcm_v2.db.SqlHelper.doTransaction][bi-servicelcm-rest]"></span></blockquote>
<b>DFW-99998</b> is one of the "<a href="https://docs.oracle.com/en/middleware/fusion-middleware/12.2.1.4/asadm/diagnosing-problems.html#GUID-5B40A738-735F-4CA2-883C-14FEA5A506B2" target="_blank">Uncaught Exception Problem Keys</a>" and its specific format is:</div><div><ul style="text-align: left;"><li>DFW-99998 [exception-name][package.class.name][app-name]</li></ul><div>For example, the <b>[app-name]</b> in the above example is <b>bi-servicelcm-rest</b>.</div><div><br /></div>
<div>
For more information about WLDF, see <a href="http://www.oracle.com/pls/topic/lookup?ctx=fmw121300&id=WLDFC">Configuring and Using the Diagnostics Framework for Oracle WebLogic Server.</a></div>
<div>
<br />
<h3>
References</h3>
<ol>
<li><a href="https://docs.oracle.com/en/middleware/fusion-middleware/12.2.1.4/asadm/diagnosing-problems.html#GUID-899EB7CC-EE70-4EF8-86E3-A5C1E10381FF" target="_blank">Diagnosing Problems</a> (Oracle Fusion Middleware Diagnostic Framework)</li>
<li><a href="https://docs.oracle.com/middleware/1213/core/FMERR/chapter_bea_messages.htm" target="_blank">Fusion Middleware Error Messages Reference</a></li>
<li><a href="https://xmlandmore.blogspot.com/2012/12/understanding-incident-and-diagnostic.html" target="_blank">Understanding WebLogic Incident and the Diagnostic Framework behind It</a> (XML and More)</li>
</ol>
<br />
<br /></div>
</div>
</div>
Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com6tag:blogger.com,1999:blog-748094882401183761.post-46212573276191921082019-02-13T11:48:00.011-06:002021-11-24T11:14:20.505-06:00OAC―Knowing Machine Learning Basics<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;"><iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen="" frameborder="0" height="315" src="https://www.youtube.com/embed/MrQM3Q_bkzw" title="YouTube video player" width="560"></iframe></div>
<div style="text-align: center;">
<span><b>Video 1. </b>Machine Learning with Oracle Analytics Cloud (YouTube <a href="https://www.youtube.com/watch?v=MrQM3Q_bkzw" target="_blank">link</a>)</span></div>
<br />
<a href="https://en.wikipedia.org/wiki/Machine_learning#Overview">Tom Mitchell</a>:<br />
<blockquote class="tr_bq">
<i><a href="https://en.wikipedia.org/wiki/Machine_learning" target="_blank">Machine Learning</a> is the study of algorithms that learn from <b>experience </b>E with respect to some class of <b>tasks </b>T and <b>performance measure</b> P, such that the algorithms’ performance at tasks in T, as measured by P, improves with experience E.</i></blockquote>
The most important part of the definition above is the experience E or the data the algorithm (a.k.a. ML model) trains on. Almost always it is <u>the data</u> that differentiates a great ML model from a good one.<br />
The new Machine Learning (<b>ML</b>) capabilities in <a href="https://cloud.oracle.com/en_US/oac" target="_blank">Oracle Analytics Cloud</a> (<b>OAC</b>) are built-in to the reporting platform and are accessible through <u>either a browser or a <a href="https://www.oracle.com/technetwork/middleware/oracle-data-visualization/downloads/oracle-data-visualization-desktop-2938957.html" target="_blank">desktop application</a></u>. You can use it to make predictions and intelligent suggestions from your ML models and data.<br />
<br />
In this article, the introduction of ML in OAC <u>will be based on video 1</u>―<b style="text-align: center;"><span style="color: blue;">Machine Learning with Oracle Analytics Cloud</span> </b><span style="text-align: center;">and </span>below topics are covered:<br />
<div>
<ul style="text-align: left;">
<li><b>Use the '<a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/analyze-data-explain.html#GUID-D1C86E85-5380-4566-B1CB-DC14E0D3919E" target="_blank">Explain</a>' functionality</b></li>
<li><b><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/create-and-use-oracle-analytics-predictive-models.html#GUID-533DCE34-CBFC-490F-BCAA-A0F99BAB6B10" target="_blank">Create and train</a> a machine learning model</b></li>
<li><b><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/create-and-use-oracle-analytics-predictive-models.html#GUID-8D2CECDC-E04F-40EC-B9E3-68AA3E7216E2" target="_blank">Analyze how effective</a> the model is</b></li>
<li><b><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/create-and-use-oracle-analytics-predictive-models.html#GUID-39F9DBFF-D2FA-4F74-975E-0799ABAA2476" target="_blank">Use an ML scenario</a> in a project</b></li>
</ul>
</div>
<div>
<br /></div>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi2YflD9z4lNyZ4zmQoNxYZTIo0MkYDFPuuupQIgFFCDflLAgBm062_H8g43TUMN8-7eZ-tOLDhrzBvznZjE-KnSdlT9-OCrh46iDSj9eD4HkFkwIWTJ-yDE4naeZyVuBYI2G9tx61eLW23/s1600/OAC_ML_Explain.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="457" data-original-width="1024" height="248" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi2YflD9z4lNyZ4zmQoNxYZTIo0MkYDFPuuupQIgFFCDflLAgBm062_H8g43TUMN8-7eZ-tOLDhrzBvznZjE-KnSdlT9-OCrh46iDSj9eD4HkFkwIWTJ-yDE4naeZyVuBYI2G9tx61eLW23/s640/OAC_ML_Explain.jpg" width="560" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><span style="font-size: x-small;"><b>Figure 1. </b>Explain functionality provided on LTV_BIN attribute</span></td></tr>
</tbody></table>
<div>
<br /></div>
<div>
<h3>
Use the 'Explain' functionality</h3>
</div>
<br />
To run Explain, simply right-click on an attribute in a data set while in <a href="https://www.oracle.com/solutions/business-analytics/data-visualization.html" target="_blank">Data Visualization</a> and select Explain (see Figure 1). Some serious algorithm crunching happens behind the scenes and then you get a popup of the findings summarized in graphical and narrative form.<br />
<div>
<div>
<br /></div>
<div>
The power of the Explain feature is that it informs you of insights that you haven’t been aware of. This is where <u>data discovery is truly independent of user bias and input</u>. For example, when applying Explain to “Customer Segment”, ML can decide:</div>
<div>
<ul style="text-align: left;">
<li>What factors make more sense to highlight in relation to Customer Segment</li>
<li>What story your data can tell</li>
<li>What different scenarios and combination of factors to look at</li>
</ul>
</div>
<div>
However, the effectiveness of doing “Explain” is going to be as efficient as the data set is well defined and the platform has enough processing power. In other words, we need to be aware of what data set we are exploring and make sure it has the right facts before starting to discover.</div>
<div>
<br />
<div>
<br /></div>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjDs2mi4bNjJXiLhvbUxjTD8uqT142EI0LPoXumquMTP1w4kKofiirAjEzd3jrdGvn8ThDaLdN9HbXqkPx2DPU5llJm76C3YM8q7fCvN45A8VleelhlM8J54LacCLzOS0H8rkMH1_7lbQxq/s1600/OAC_ML_Train_Model.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="900" data-original-width="1600" height="315" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjDs2mi4bNjJXiLhvbUxjTD8uqT142EI0LPoXumquMTP1w4kKofiirAjEzd3jrdGvn8ThDaLdN9HbXqkPx2DPU5llJm76C3YM8q7fCvN45A8VleelhlM8J54LacCLzOS0H8rkMH1_7lbQxq/s640/OAC_ML_Train_Model.jpg" width="560" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><span style="font-size: x-small;"><b>Figure 2. </b>Data flow step options including <span style="color: blue; text-align: start;"><span>Train Multi-Classifier</span></span></span></td></tr>
</tbody></table>
<div class="separator" style="clear: both; text-align: center;">
<br /></div>
<div class="separator" style="clear: both; text-align: center;">
<br /></div>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjcB5l4Dm3hq4XfjGp-AzCJZkz_zcapKPIgXt96YqP-r1iMb8wweuF7rnDwytUyqHm6ZRdbM8MMkkuNWXqxEnhrR27MlKcJ3RCIrFBQ0pu612QBODaoKj0Xwt7cSEefdS8yyoKlu2vysb6Z/s1600/ML_Train_Model.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="997" data-original-width="1202" height="464" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjcB5l4Dm3hq4XfjGp-AzCJZkz_zcapKPIgXt96YqP-r1iMb8wweuF7rnDwytUyqHm6ZRdbM8MMkkuNWXqxEnhrR27MlKcJ3RCIrFBQ0pu612QBODaoKj0Xwt7cSEefdS8yyoKlu2vysb6Z/s640/ML_Train_Model.jpg" width="560" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><span style="font-size: x-small;"><b>Figure 3. </b>Optimizer Options including Adam Optimizer</span></td></tr>
</tbody></table>
<div>
<br /></div>
<h3>
Create a Train Model for a Data Flow</h3>
<div>
<br />
As a advanced analyst, you can use <b>scripts </b>(e.g. <b><span style="color: blue;">Neural Network for Classification</span></b>) to train data models that you then add to other sets of data to predict trends and patterns in data.<br />
<br />
Scripts define the interface and logic (code) for machine learning tasks. You can use a training task (classification or numeric prediction), for example, to train a model based on known (<b>labeled</b>) data. When the model is built, the same can be used to score unknown data (that is, <b>unlabeled</b>) to:<br />
<ul style="text-align: left;">
<li>Generate a data set within a data flow, or </li>
<li>Provide a prediction dynamically within a visualization. </li>
</ul>
Machine learning tasks are available as individual step types (for example, <b>Train Binary</b>, <b>Apply Model</b>).<br />
<br />
For example, you could train a model on a set of data that includes customer information and then apply this model to a set of new customer data that doesn't include <a href="https://en.wikipedia.org/wiki/Customer_lifetime_value" target="_blank">Life-Time Value</a> (<b>LTV</b>) information. Because the model is based on specific factors and is 97% accurate, it can accurately predict how many and which new customers in the data set most likely have a high customer lifetime value. In the below demonstration, <span style="color: blue;"><b>Train Multi-Classifier</b></span> is used to classify customers into 4 LTV bins (i.e., <i>Low</i>, <i>Medium</i>, <i>High</i>, <i>Very High</i>):</div>
<div>
<br /></div>
<ol style="box-sizing: border-box; margin-bottom: 10px; margin-top: 0px; text-align: left;">
<li>In the Data tab, select a data set that you want to use in the data flow.</li>
<li>In the Data Flows tab, click <b>Create </b>and select <b>Data Flow</b>.</li>
<li>Select the data set (e.g. <span style="color: blue;"><b>Customer Insurance LTV - Local</b></span>) that you want to use to create your train model, and click <b>Add</b>.</li>
<li>In the data flow, click the <b>Plus (+)</b> symbol.</li>
<li>This displays all available data flow step options (see Figure 2), including train model types (for example, <span style="color: blue;"><b>Train Numeric Predictions</b></span>, <span style="color: blue;"><b>Train Multi-Classifier</b></span>).<sup>[22]</sup></li>
<li>Click the train model type that you want to apply to the data set.</li>
<ul>
<li>For example, <i>Train Multi-Classifier</i> is a multiclass train model that helps predict which <span style="color: blue;"><b>LTV_BIN</b> </span>(i.e. Low, Medium,, High, Very High) a new customer will be classified into.</li>
</ul>
<li>Refine the field details for the model as required:</li>
<ul>
<li>If you want to change the script, then click <b>Model Training Script</b>.</li>
<li>Click <b>Target </b>to select a Data Set column that you want to apply the train model to.</li>
<ul>
<li>For example, you might want to model the customer data to predict a person's <b style="color: blue;">LTV_BIN</b>. Consider an agent who is interested in keeping customers who have potentially High LTV.</li>
</ul>
<li>Update the remaining fields with values that are appropriate for the script you selected (see Figure 3).</li>
</ul>
<li>Click <b>Save</b>, enter a name and description and click <b>OK </b>to save the data flow with your choice of parameter values for the current train model script.</li>
<li>Click <b>Save Model</b>, enter a name (e.g. <b><span style="color: blue;">Predict LTV Bin - NN</span></b>) and description, and click <b>Save </b>to save the model.</li>
<ul>
<li>You can now run the model script like any other data flow.</li>
</ul>
</ol>
<div>
</div>
<div>
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjMdk7j7iYIYtlSfyJa6My9Oga2m0VYyHaGDuWlcLji-nsNEr0Ew0gnCJq7J0Aax75dXtoRLwPLLjj4pnK-BJQwVvebGC2Q-0soHqS8nn117k5gQG_6zHu9g4YEGgkZMUoc3_dqAH3jYxNg/s1600/ML_Scripts_Models_Tab.jpg" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="215" data-original-width="452" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjMdk7j7iYIYtlSfyJa6My9Oga2m0VYyHaGDuWlcLji-nsNEr0Ew0gnCJq7J0Aax75dXtoRLwPLLjj4pnK-BJQwVvebGC2Q-0soHqS8nn117k5gQG_6zHu9g4YEGgkZMUoc3_dqAH3jYxNg/s1600/ML_Scripts_Models_Tab.jpg" /></a></div>
<div class="separator" style="clear: both; text-align: center;">
<span style="font-size: x-small;"><b>Figure 4.</b> Machine Learning view with Scripts and Models tabs</span></div>
<div class="separator" style="clear: both; text-align: center;">
<b><br /></b></div>
<div class="separator" style="clear: both; text-align: center;">
<br /></div>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhlaHzMGUyzNh0b1sbpNJPhCeZqgcNoFRE_xpxExVcazzrZ7wvhZCvWfpuR7Xm2u16NClV0Ih0ZhGWDlap24IGIDYG0TqEWNQJ8bP2Fs9oSJYyoW8f4qUaoZe_oJ1UCL52X0CGPY99yp4i4/s1600/ML_Quality_Tab.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="465" data-original-width="720" height="362" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhlaHzMGUyzNh0b1sbpNJPhCeZqgcNoFRE_xpxExVcazzrZ7wvhZCvWfpuR7Xm2u16NClV0Ih0ZhGWDlap24IGIDYG0TqEWNQJ8bP2Fs9oSJYyoW8f4qUaoZe_oJ1UCL52X0CGPY99yp4i4/s640/ML_Quality_Tab.jpg" width="560" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><span style="font-size: x-small;"><b>Figure 5.</b> Confusion Matrix indicates actual values against predicted values</span></td></tr>
</tbody></table>
<br />
<h3>
Analyze How Effective the Train Model Is</h3>
<br />
Once you’ve created a <b>train model</b>, you can explore information about it and how it interprets data. You can use that information to modify the model.</div>
<div>
<br />
When you run a train model data flow, it produces outputs which you can interpret, so that you can refine the model.</div>
<ol style="text-align: left;">
<li>Click the Navigator icon and select <b>Machine Learning</b>.</li>
<ul>
<li>Machine Learning displays the <b>Scripts </b>and <b>Models </b>tabs (see Figure 4).</li>
</ul>
<li>To view the train model data flow outputs, display the Models tab.</li>
<ul>
<li>This displays all models created.</li>
</ul>
<li>Click the menu icon for a model (e.g. <b><span style="color: blue;">Predict LTV Bin - NN</span></b>) and select the <b>Inspect </b>option.</li>
<ul>
<li>This displays four tabs: <b>General</b>, <b>Quality</b>, <b>Permissions </b>and <b>Related</b>.</li>
</ul>
<li>(Optional) Click <b>General</b>.</li>
<ul>
<li>This page shows information about the model including: </li>
<ul>
<li><b>Predicts </b>- The name of whatever the model is trying to predict (e.g. <span style="color: blue;"><b>LTV_BIN</b></span>). </li>
<li><b>Trained On</b> - The name of the data set (e.g. <span style="color: blue;"><b>Customer Insurance LTV - Local</b></span>) that you're using to train the model. </li>
<li><b>Script </b>- The name of the script (e.g. <b><span style="color: blue;">Neural Network for Classification</span></b>) used in the model. </li>
<li><b>Class </b>- The class of script (for example, <span style="color: blue;"><b>Multiclass Classification</b></span>). </li>
</ul>
</ul>
<li>(Optional) Click <b>Quality</b>.</li>
<ul>
<li>A portion (configurable) of the training data set is kept aside for validation purposes. When the model is built, it’s applied to the validation data set with known labels. A different set of metrics such as <span style="color: blue;"><b>Accuracy</b></span>, <span style="color: blue;"><b>Precision</b></span>, and <span style="color: blue;"><b>Recall </b></span>are calculated based on Actual (Label) and Predicted Values. Information is also shown as a <a href="https://www.dataschool.io/simple-guide-to-confusion-matrix-terminology/" target="_blank">matrix</a>, that you can use to provide quick simple summaries of what is found during validation. </li>
<li>The Quality page displays:</li>
<ul>
<li>A list of standard metrics, where the metrics displayed are related to the model selected. Each metric helps you determine how good the model is in terms of its prediction accuracy for the selected Data Set column to which you apply the train model.</li>
<li>The matrix shows the state of the data used to make the predictions.</li>
<ul>
<li>The <a href="https://www.dataschool.io/simple-guide-to-confusion-matrix-terminology/" target="_blank">matrix</a> indicates actual values against predicted values to help you understand if the predicted values are close to the actual values (see Figure 5).</li>
</ul>
</ul>
</ul>
<li>(Optional) Click <b>Related</b>.</li>
<ul>
<li>Related tab captures data sets emitted by the machine learning scripts when run to build models. The data sets capture specific information related to the script logic (e.g., multiclass classification), so that advanced users (data scientists) can get more insights into the model built.</li>
<li>This page shows the training data including:</li>
<ul>
<li><b>Training Data</b> - The data set being used to train the model.</li>
<li><b>Generated Data</b> - The data sets created by the script that you use for the training model. You may see different data sets if you select another script to train a model.</li>
</ul>
</ul>
</ol>
</div>
<div>
<br />
<div>
<h3>
<a href="https://docs.microsoft.com/en-us/azure/machine-learning/studio-module-reference/machine-learning-score" target="_blank">Score</a> a Model</h3>
<div>
<br /></div>
You can apply a train model within a data flow to generate a data set.<br />
<ol style="box-sizing: border-box; margin-bottom: 10px; margin-top: 0px; text-align: left;">
<li>In the <b>Data</b> tab, select a data set that you want to use in the data flow.</li>
<ul>
<li>This can be any data set containing data that you want to apply your model to.</li>
</ul>
<li>In the Data Flows tab, click <b>Create </b>and select <b>Data Flow</b> to display the Add Data Set pane.</li>
<li>Select the data set (e.g. <span style="color: blue;"><b>Customer Insurance New</b></span>) to which you want to apply the model, and click <b>Add</b>.</li>
<ul>
<li>Select a data set like the one used to create the model.</li>
</ul>
<li>In the data flow, click the <b>Plus (+)</b> symbol.</li>
<li>Click <b>Apply Model</b> from the available options.</li>
<li>Select a model (e.g. <b><span style="color: blue;">Predict LTV Bin - NN</span></b>) from the list of available models and click <b>OK </b>to confirm. </li>
<li>Select the <b>Output </b>columns that you want generated by this data flow, and update Column Name fields (e.g. <span style="color: blue;"><b>LTV_BIN</b></span> and <span style="color: blue;"><b>PredictionConfidence</b></span>) if required.</li>
<ul>
<li>The output columns displayed in the Apply Model pane are created as a data set when the data flow runs. </li>
<li>The output columns are relevant to the model. </li>
</ul>
<li>In the data flow, click the <b>Plus (+)</b> symbol and select <b>Save Data</b> to add a Save Data step. </li>
<li>Click <b>Save</b>, enter a name (e.g. <b><span style="color: blue;">Customer w LTV BIN</span></b>) and description and click OK to save the data flow with the selected model and output.</li>
<ul>
<li>You can now run the data flow to create the appropriate output data set columns using the selected model.</li>
</ul>
</ol>
A data set that you create using a scoring data flow can be used within a visualization in the same way as any other data set.<br />
<br />
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgluCZDzwn6c_j0UHypkSvGeOsKRhatvVXAWSs02WUKTcWPitDhS3T3ITc-gEhwXlZgjuq9NS37ncfUolNMAljxpXuEJwF_0Cb71hdx3egGEKV2_J1ldZ2it7ir8fqKxbKq1ywtKx0RK7BC/s1600/ML_Create_Scenario1.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="428" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgluCZDzwn6c_j0UHypkSvGeOsKRhatvVXAWSs02WUKTcWPitDhS3T3ITc-gEhwXlZgjuq9NS37ncfUolNMAljxpXuEJwF_0Cb71hdx3egGEKV2_J1ldZ2it7ir8fqKxbKq1ywtKx0RK7BC/s1600/ML_Create_Scenario1.jpg" /></a></td></tr>
<tr><td class="tr-caption"><span style="font-size: x-small;"><b>Figure 6.</b> Right-click the data set</span><span style="font-size: x-small;"> (e.g. <i>Customer Insurance New</i>) and select Create Scenario</span></td></tr>
</tbody></table>
<br />
<br />
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjWZFharDN175vKWxF8JOPSa4t1t8UoobNbbunVtJ74gl8UhiYxr4KhghJiU-a63CRwEBgvQnYwHMiz8Q2gtEX1gi33Ojfasadea05YEEpdr8LP7dtsjjXDEm-EAwqlzfO08L5jQ9LbMPf-/s1600/ML_Create_Scenario.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="492" data-original-width="1024" height="268" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjWZFharDN175vKWxF8JOPSa4t1t8UoobNbbunVtJ74gl8UhiYxr4KhghJiU-a63CRwEBgvQnYwHMiz8Q2gtEX1gi33Ojfasadea05YEEpdr8LP7dtsjjXDEm-EAwqlzfO08L5jQ9LbMPf-/s640/ML_Create_Scenario.jpg" width="560" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><span style="font-size: x-small;"><b>Figure 7. </b> Create Scenario - Select Model dialog</span></td></tr>
</tbody></table>
<br /></div>
<div>
<h3>
Add Scenarios to a Project</h3>
</div>
<div>
<br /></div>
<div>
You can apply scenarios within a project by selecting from a list of available machine learning models, joining the model to the existing data sets within a project, then using the resulting model columns within a visualization. A scenario enables you to add a set of virtual model output columns to create a blended report, which isn't unlike adding data directly to a project to create blended visualization. You can use the predicted values for the subset of the data of interest within a specific visualization. The <u>virtual data set columns</u> don’t physically exist, they represent the model outputs and their values are <u>dynamically generated</u> when used in a visualization.</div>
<div>
<ol>
<li>Create or open the <b>Data Visualization</b> project in which you want to apply a scenario.</li>
<ul>
<li>Confirm that you’re working in the <b>Visualize canvas</b>.</li>
</ul>
<li>To add a scenario, do one of the following:</li>
<ul>
<li>Click <b>Add</b>, and select <b>Create Scenario</b>.</li>
<li>In the Data Elements pane, right-click the data set (e.g. <span style="color: blue;"><b>Customer Insurance New</b></span>) and select Create Scenario (see Figure 6).</li>
</ul>
<li>In the <b>Create Scenario - Select Model</b> dialog, select the name of the model (e.g. <b><span style="color: blue;">Predict LTV Bin - NN</span></b>) and click <b>OK </b>(see Figure 7).</li>
<li>In the <b>Map Your Data to the Model</b> dialog, specify various options:</li>
<ul>
<li>In a project with multiple data set, click <b>Data Set</b> to select a data set that you want to map to the model.</li>
<li>In the table, click <b>Select Column</b> to match a column to a model input.</li>
<ul>
<li>Each model has inputs (that is, data elements) that must match corresponding columns from the data set. If the data type (for example, column name) of a model input matches a column, then the input and column are automatically matched. If a model input has a data type that doesn't match any column, you must manually specify the appropriate data element.</li>
<li>Click <b>Show all inputs</b> to display the model inputs and the data elements with which they match. Alternatively, click <b>Show unmatched inputs</b> to display the model inputs that aren’t matched with a column.</li>
</ul>
</ul>
<li>Click <b>OK </b>to add the resulting model columns to the Data Elements pane. You can now use the <u>model columns</u> with the <u>data set columns</u>.</li>
<li>Drag and drop one or more data set and model columns from the Data Elements pane to drop targets in the Visualize canvas. You can also double-click the columns to add them to the canvas.</li>
</ol>
You can add one or more scenarios to the same or different data sets. In the Data Elements pane right-click the model, and select one of the following options:<br />
<ul style="text-align: left;">
<li><b>Edit Scenario</b> - Open the Map Your Data to the Model dialog to edit a scenario.</li>
<li><b>Reload Data</b> - Update the model columns after you edit the scenario.</li>
<li><b>Remove from Project</b> - Open the Remove Scenario dialog to remove a scenario.</li>
</ul><div class="separator" style="clear: both; text-align: center;"><br /></div><div class="separator" style="clear: both; text-align: center;"><iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen="" frameborder="0" height="315" src="https://www.youtube.com/embed/wWaJYnBUT7s" title="YouTube video player" width="560"></iframe></div><div style="text-align: center;"><span><b>Video 2. </b>Use Explain to Discover Data Insights in Oracle Analytics (YouTube <a href="https://www.youtube.com/watch?v=wWaJYnBUT7s" target="_blank">link</a>)</span></div><div style="text-align: center;"><span style="font-size: x-small;"><br /></span></div><div style="text-align: left;">
<div class="separator" style="clear: both; text-align: center;"><iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen="" frameborder="0" height="315" src="https://www.youtube.com/embed/0qmsJgxFea4" title="YouTube video player" width="560"></iframe></div><div style="text-align: center;"><span><b>Video 3. </b> OAC Workshop : Basics of Training & Applying Predictive Models With Oracle DV (YouTube <a href="https://www.youtube.com/watch?v=0qmsJgxFea4" target="_blank">link</a>)</span></div><div style="text-align: center;"><span style="font-size: x-small;"><br /></span></div><div><div class="separator" style="clear: both; text-align: center;"><iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen="" frameborder="0" height="315" src="https://www.youtube.com/embed/kv3CB21Kelk" title="YouTube video player" width="560"></iframe></div><div style="text-align: center;"><span><b>Video 4.</b> Oracle Analytics Cloud: Augmented Analytics with AI and ML (YouTube <a href="https://www.youtube.com/watch?v=kv3CB21Kelk" target="_blank">link</a>)</span></div><span style="font-size: x-small;"><br /></span></div><div style="text-align: center;"><span style="font-size: x-small;"><br /></span></div></div>
<h3>
References</h3>
<ol style="text-align: left;">
<li><a href="https://www.youtube.com/watch?v=MrQM3Q_bkzw" style="background-color: yellow;" target="_blank">Machine Learning with Oracle Analytics Cloud</a> (YouTube)</li>
<li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/use-machine-learning-analyze-data.html" target="_blank">Use Machine Learning to Analyze Data</a> (OAC)</li>
<li><a href="https://blogs.perficient.com/2018/04/24/3-easy-ways-to-do-ml-with-oracle-analytics-cloud/" target="_blank">3 Easy Ways to do ML with Oracle Analytics Cloud</a></li>
<li><a href="https://www.youtube.com/watch?v=0qmsJgxFea4" style="background-color: yellow;" target="_blank">Oracle DV Workshop - Basics of Training & Applying Predictive Models With Oracle DV</a> (Youtube)</li>
<li><a href="https://www.youtube.com/watch?time_continue=8&v=ti7DtkTlGVo" style="background-color: yellow;" target="_blank">Create Data Flows in Oracle Data Visualization V5</a> (YouTube)</li>
<li><a href="http://oracledataviz.blogspot.com/2018/03/how-to-populate-quality-tab-in-ml-model.html" target="_blank">How to Populate Quality Tab in ML Model Inspect page in Oracle Analytics Cloud</a></li>
<li><a href="http://andrew.gibiansky.com/blog/machine-learning/machine-learning-the-basics/" target="_blank">Machine Learning Basics</a></li>
<li><a href="https://www.youtube.com/watch?v=IvbfIbdTVYM" style="background-color: yellow;" target="_blank">Machine Learning with Oracle Big Data Cloud</a> (YouTube)</li>
<li>Data Visualization (<a href="https://community.oracle.com/community/groundbreakers/business_intelligence/data-visualization" target="_blank">Forum</a>)</li>
<li><a href="https://docs.oracle.com/en/middleware/bi/data-visualization-desktop/index.html" target="_blank">Oracle Data Visualization Desktop</a> (Documentation)</li>
<li><a href="https://www.oracle.com/solutions/business-analytics/data-visualization/library-overview.html" target="_blank">Oracle Analytics Library</a></li>
<li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/use-data-flows-create-curated-data-sets.html" target="_blank">Visualizing Data and Building Reports in Oracle Analytics Cloud</a></li>
<li><a href="https://docs.oracle.com/en/cloud/paas/data-visualization-cloud/bidvc/getting-started-data-visualization.html" target="_blank">Using Oracle Data Visualization Cloud Service</a></li>
<li><a href="https://docs.oracle.com/middleware/bi12214/biee/BIVUG/BIVUG.pdf" target="_blank">Oracle® Fusion MiddlewareUser's Guide for Oracle Data Visualization</a> (PDF)</li>
<li><a href="https://docs.oracle.com/en/middleware/bi/data-visualization-desktop/dvdwn/index.html#DVDWN-GUID-5B4445B4-3BD9-40AD-AD11-E75BFB5543D1" target="_blank">What's New for Oracle Data Visualization Desktop</a></li>
<li><a href="http://www.ateam-oracle.com/ml-with-oracle-database-cloud-advanced-analytics/" target="_blank">Machine Learning</a> (Oracle A-Team Chronicles) </li>
<li><a href="http://oracledataviz.blogspot.com/" target="_blank">Oracle Underground BI & Dataviz</a> (Blogger)</li>
<li><a href="https://www.safaribooksonline.com/library/view/data-science-for/9781449374273/" target="_blank">Data Science for Business</a> (Safari)</li>
<li><a href="https://blogs.oracle.com/analyticscloud/learn-modern-data-visualization-with-oracle-analytics" target="_blank">Learn Modern Data Visualization with Oracle Analytics</a></li><li>Click <a href="https://www.oracle.com/business-analytics/" target="_blank">here</a> for more A-Team Oracle Analytics (OAC) Blogs.</li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/register-and-use-oracle-machine-learning-models.html#GUID-C3E0DC8C-E274-44E1-852E-FC5DAC2765E7" target="_blank">How Can I Use Oracle Machine Learning Models in Oracle Analytics?</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/create-and-use-oracle-analytics-predictive-models.html#GUID-A3FB98CB-7EB1-4195-A061-510D91EF0254" target="_blank">How Do I Choose a Predictive Model Algorithm?</a></li></ol></div>
</div>
</div>
</div>
Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com2tag:blogger.com,1999:blog-748094882401183761.post-12408994732884363062019-02-10T12:18:00.006-06:002021-06-06T17:28:02.600-05:00OAC―Loading Data with Data Sync<div dir="ltr" style="text-align: left;" trbidi="on">
<meta name="viewport" content="width=device-width, initial-scale=1">
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/Cd2-l8iu2N4/0.jpg" frameborder="0" height="266" src="https://www.youtube.com/embed/Cd2-l8iu2N4?feature=player_embedded" width="320"></iframe></div>
<div style="text-align: center;">
<b><span style="font-size: x-small;">Video 1. Getting Started with Loading Data</span></b></div>
<div>
<br /></div>
<div dir="ltr" trbidi="on">
Preparing business data in <a href="https://cloud.oracle.com/en_US/oac" target="_blank">Oracle Analytics Cloud</a> (<b>OAC</b>) for analysis, the first step is to upload your data:</div>
<div dir="ltr" trbidi="on">
<ul style="text-align: left;">
<li><b>From </b>Source Data</li>
<ul>
<li>You can load data from <u>files </u>(CSV and XLSX), various <u>relational sources</u> (tables, views, SQL statements), <a href="https://blogs.oracle.com/dylanwan/otbi-vs-obia">OTBI</a>, <u>JDBC </u>data sources, and <u><a href="https://www.oracle.com/uk/products/applications/rightnow/overview/">Oracle Service Cloud</a></u>.</li>
</ul>
<li><b>To </b>Target Data</li>
<ul>
<li>You can load to <u>relational tables</u>, <u><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/add-data-sets.html" target="_blank">data sets</a></u>, <u><a href="https://www.mindstreamanalytics.com/articles/essbase_cube.html">Essbase cubes</a></u>, or <u>flat-files</u>. </li>
</ul>
</ul>
</div>
<div dir="ltr" trbidi="on">
In the upload process, the data is cleaned, transformed, cataloged and made available for data mining, online analytical processing, market research and decision support.</div>
<span face="" style="background-color: #e2e7f6; font-size: 13px;"><br /></span>
As a Data Loader, you can use <a href="https://docs.oracle.com/en/cloud/paas/bi-cloud/bilpd/data-sync-reference.html" target="_blank">Data Sync</a>, REST API, or <a href="https://www.oracle.com/database/technologies/appdev/sql-developer.html">SQL Developer</a> to upload data (watch video 1). For illustration, we will only cover <u>uploading data to the cloud using Data Sync</u> in this article.<br />
<span style="background-color: #e2e7f6;"><br /></span>
<br />
<h3>
When to Use Data Sync</h3>
<br />
Use <a href="https://docs.oracle.com/en/cloud/paas/bi-cloud/bilpd/data-sync-reference.html" target="_blank">Data Sync</a> when you want to:<br />
<ul style="text-align: left;">
<li><b>Load data</b></li>
<ul>
<li>From <u>both Oracle and non-Oracle data sources</u>, including <a href="https://stackoverflow.com/questions/21570751/difference-between-clob-and-blob-from-db2-and-oracle-perspective">CLOB andBLOB format</a>.</li>
<li>From <u>a combination of data sources</u>, such as CSV and Oracle relational data.</li>
</ul>
<li><b>Merge data</b> </li>
<ul>
<li>You can merge data from multiple sources.</li>
</ul>
<li><b>Transform </b><b>data </b></li>
<ul>
<li>You can transform your data while loading it, including formatting, joining, masking, and
scrambling. </li>
</ul>
<li><b>Schedule </b>data loads</li>
<ul>
<li>You can replace, append, and update data in tables by
scheduling data loads and using the <u>Load Strategy</u> option of this utility.</li>
<ul>
<li><u>Incremental data loads</u> or <u>rolling deletes</u>.</li>
<li><u>Insert-only</u> or <u>append</u><b> </b>strategies. </li>
</ul>
</ul>
</ul>
<div>
<br /></div>
<div>
<h3>
Loading Data</h3>
<div>
<br />
With <a href="https://docs.oracle.com/en/cloud/paas/bi-cloud/bilpd/data-sync-reference.html" target="_blank">Data Sync</a> you can quickly load data from a data source to OAC, <a href="https://www.oracle.com/technetwork/middleware/essbase/overview/index.html">Oracle Essbase</a>, or flat-file format(e.g. CSV, ZIP, or XLSX).</div>
<div style="text-align: left;">
<br /></div>
<div style="text-align: left;">
Below are the tasks to be performed:</div>
<div style="text-align: left;">
<br /></div>
<div style="text-align: left;">
<table border="1" cellpadding="2" cellspacing="2" style="width: 677px;"><tbody>
<tr><td valign="top"><b>Task </b></td><td valign="top"><b>Description</b></td><td valign="top"><b>More Information</b></td></tr>
<tr><td valign="top">1. Download and install Data Sync</td><td valign="top">Download Data Sync from Oracle Technology Network and follow the installation steps.</td><td valign="top"><a href="http://www.oracle.com/%20technetwork/%20middleware/oac/%20downloads/index.html" target="_blank">http://www.oracle.com/technetwork/middleware/oac/downloads/index.html </a></td></tr>
<tr><td valign="top">2. Request permissions to load data</td><td valign="top">Work with your service administrator to ensure that you have permissions to load data.</td><td valign="top"><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/preparing-data-oracle-analytics-cloud.pdf#page=26" target="_blank">Give Users Permissions toUpload Data with DataSync</a></td></tr>
<tr><td valign="top">3. Change default environment properties</td><td valign="top">Configure Data Sync for your local environment. </td><td valign="top"><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/preparing-data-oracle-analytics-cloud.pdf#page=26" target="_blank">Set Default Options forData Sync</a></td></tr>
<tr><td valign="top">4. Create a new data loading project</td><td valign="top">Create a project, specify connections, set up the loading options, and load your data.</td><td valign="top"><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/preparing-data-oracle-analytics-cloud.pdf#page=26" target="_blank">Quick Guide to Loading Data With Data Sync</a></td></tr>
</tbody></table>
<br />
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiAfn_7v9iCbTgW_lPWpHGK58pk33baL9EVeyj9drmU-QNFU8Gwiy2FD14zsypU94seYLIAoV2FuB9oBW2oHYQpirLN6ds1gjDVmSlXA6HUR7zCBkF91wUfa69VvJ1d6i-vKXHxcicef5Gk/s1600/DataSyncProject.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="209" data-original-width="496" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiAfn_7v9iCbTgW_lPWpHGK58pk33baL9EVeyj9drmU-QNFU8Gwiy2FD14zsypU94seYLIAoV2FuB9oBW2oHYQpirLN6ds1gjDVmSlXA6HUR7zCBkF91wUfa69VvJ1d6i-vKXHxcicef5Gk/s1600/DataSyncProject.jpg" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 2. <span style="color: blue;">Project</span> view with <span style="color: blue;">Data Flows</span>, <span style="color: blue;">Script Processing</span>, and <span style="color: blue;">Parameters </span>sub-tabs</b></td></tr>
</tbody></table>
</div>
<div>
<b><br /></b>
<b><u>Data Loading Details</u></b><br />
<ul style="text-align: left;">
<li><b>User Permission</b></li>
<ul>
<li>To load data using Data Sync, you need a user account with appropriate privileges. For instance, you need to assign users below <a href="https://xmlandmore.blogspot.com/2019/02/oacgetting-started-with-oracle.html#ApplicationRoles" target="_blank">application roles</a>:</li>
<ul>
<li><b>BI Dataload Author</b> - Enables Data Sync users to load data into a <u>table</u>. </li>
<li><b>DVContent Author</b> - Enables Data Sync users to load data into a <u>data set</u></li>
</ul>
</ul>
<li><b>Default Options</b></li>
<ul>
<li><b>Data File Root
Directory</b> property</li>
<ul>
<li>To specify the default location for source files</li>
</ul>
<li><b>Proxy Host</b> and <b>Proxy Port</b> </li>
<ul>
<li>If your organization uses a proxy server to route calls to external websites,</li>
</ul>
<li>How much detail gets logged</li>
<li>How long to keep log files</li>
</ul>
<li><b>New Data Loading <span style="color: blue;">Project </span></b>(see Figure 2)</li>
<ul>
<li>When you create a data loading project, you specify which data columns to load and
how you want to load them.</li>
<li>In the <b>Connections </b>view, specify connection details:</li>
<ul>
<li> See
<a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/preparing-data-oracle-analytics-cloud.pdf#page=27">Specify Connection Details for Your </a><b><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/preparing-data-oracle-analytics-cloud.pdf#page=27">Data Targe</a>t</b></li>
<ul>
<li>Your data target might be <a href="https://cloud.oracle.com/database">Oracle Database Cloud Service</a>, <a href="https://cloud.oracle.com/en_US/datawarehouse">OracleAutonomous Data Warehouse</a>, or <a href="https://www.oracle.com/solutions/business-analytics/business-intelligence/essbase/">Oracle Essbase</a>.</li>
</ul>
<li> See <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/preparing-data-oracle-analytics-cloud.pdf#page=27">Specify Connection Details for a DataSource</a></li>
</ul>
<li>In the <b>Project </b>view, specify loading options</li>
<ul>
<li> See <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/preparing-data-oracle-analytics-cloud.pdf#page=27">Set Up Your DataLoad</a>.</li>
<ul>
<li>At the <b>Import Definition into <project></b> dialog box, choose a load type: </li>
<ul>
<li><u>Discover</u> object from
catalog</li>
<li><u>Type</u> list of object names</li>
<li><u>Enter</u> object's properties
manually</li>
<li><u>Add</u> target to an existing
source</li>
</ul>
<li>In the <b>Data Flows</b> tab, </li>
<ul>
<li>Click <b>Edit </b>to drill into source or target details, or update
the <b><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/preparing-data-oracle-analytics-cloud.pdf#page=69" target="_blank">data load strategy</a></b>. </li>
<li>Click <b>Column Mapping</b> to add transformations or joins.</li>
</ul>
<li>In the <b>Script Processing</b> tab, run SQL commands before, during, or after a
data load. </li>
<ul>
<li>For example, you might want to create indexes or remove
temporary tables. </li>
</ul>
<li>In the <b>Parameters </b>tab, specify run-time values</li>
<ul>
<li>For example, Last Replication
Date.</li>
</ul>
</ul>
</ul>
<ul>
</ul>
</ul>
</ul>
</div>
</div>
</div>
<ul>
</ul>
<br />
<h3>
Transforming Data</h3>
<br />
You can use Data Sync to transform relational data if you‘re loading data into either Oracle Database Cloud Service or an on-premises database that is configured using the ‘Oracle (Thin)’ connection type.<br />
<br />
These transformation types are supported:<br />
<ul style="text-align: left;">
<li><b>Uppercase </b>- Convert lower-case characters to upper-case. </li>
<li><b>Lowercase </b>- Convert upper-case characters to lower-case. </li>
<li><b>Trim </b>- Remove part of a field. </li>
<li><b>Number </b>- Convert a string to a number by stripping away non-numeric characters. </li>
<li><b>Mask </b>(Custom, Simple, Null) - Hide parts of data fields. For example, you might
want to hide credit-card numbers, or hide the first 12 digits of credit-card numbers. </li>
<li><b>Obfuscate </b>(various) - Scramble data. For example, you might want to convert
credit-card numbers to strings of alpha-numeric characters, or add a 30% variance
to age data. </li>
<li><b>Obfuscate dates</b> - Convert dates to a date range. For example, you might want to
show approximate date of birth. </li>
</ul>
<div>
<br /></div>
<div>
<b><u>More Transformation Options</u></b><sup>[12]</sup></div>
<div>
<br /></div>
<div>
You can use the <b>Column Mapping</b> dialog box or <b>Mapping </b>dialog box to configure your
transformations. For example, you can use Data Sync to transform your data </div>
<div>
<ol style="text-align: left;">
<li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/preparing-data-oracle-analytics-cloud.pdf#page=72">With DefaultValues, Conversions,and Calculations</a></li>
<li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/preparing-data-oracle-analytics-cloud.pdf#page=72">With New Target Columns</a></li>
<li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/preparing-data-oracle-analytics-cloud.pdf#page=74">Using Joins</a></li>
<li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/preparing-data-oracle-analytics-cloud.pdf#page=73">Using SurrogateKeys</a></li>
<ul>
<li>To improve performance</li>
</ul>
</ol>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi_byiwzccRXTsQvOx-mYktAUsF4Op3a7r6nFu2XSl-uaTfjG20co1Usq9wTlBPwlCLvSdLrEeo08Zy0-rIjqKxAMz5sWLWBb3r_ViC65cZ4BFZ-iecLzSHyBOimnIvRw2Ouflh2hMOmGQv/s1600/DataSyncJobs.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="175" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi_byiwzccRXTsQvOx-mYktAUsF4Op3a7r6nFu2XSl-uaTfjG20co1Usq9wTlBPwlCLvSdLrEeo08Zy0-rIjqKxAMz5sWLWBb3r_ViC65cZ4BFZ-iecLzSHyBOimnIvRw2Ouflh2hMOmGQv/s1600/DataSyncJobs.jpg" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 1. <span style="color: blue;">Jobs</span> view with <u>Jobs</u>, <u>Schedules</u>, and <u>Runs</u> sub-tabs.</b></td></tr>
</tbody></table>
<br /></div>
<h3>
Scheduling Data Load</h3>
<br />
After you have set up your data in Data Sync, you can use a job (see <b>Jobs</b> view in Figure 1):<br />
<ul style="text-align: left;">
<li>To load the data from the
data source into the data target</li>
<ul>
<li>See <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/preparing-data-oracle-analytics-cloud.pdf#page=66" target="_blank">Starting a Data Load</a></li>
</ul>
<li>To refresh data regularly by scheduling a job</li>
<ul>
<li>See <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/preparing-data-oracle-analytics-cloud.pdf#page=72" target="_blank">Refreshing Data Regularly</a></li>
</ul>
<li>To monitor progress and respond to loading
issues.
</li>
<ul>
<li>See <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/preparing-data-oracle-analytics-cloud.pdf#page=67" target="_blank">Monitoring Data Loads</a> </li>
</ul>
</ul>
<br />
<b><u>Scheduling Details</u></b><br />
<ul style="text-align: left;">
<li><b>Default Job</b></li>
<ul>
<li>Before you start, on the Jobs sub-tab, configure a job. </li>
<li>You can either use
the <u>default job</u> that Data Sync created for you based on the current project
name, or create your own job.</li>
<ul>
</ul>
</ul>
<li><b>Starting Data Load</b></li>
<ul>
<li>In the <b>Jobs </b>view, start the data load:</li>
<ul>
<li>Use the <b>New Job</b> dialog to specify a job name and loading details</li>
<li>Use the <b>Override With</b> option to specify a data source and data target</li>
<li>In the <b>Configure Initial Extract</b> dialog, specify whether you want to perform a <u>full load</u> or <u>incremental load</u></li>
</ul>
</ul>
<li><b>Scheduling Job</b></li>
<ul>
<li>In the Schedules sub-tab, click New to display the <b>New Schedule</b> dialog</li>
<ul>
<li>In the Job list, select the job</li>
<li>In the <b>Recurrence Pattern</b> area to specify when and how regularly you want to
load the data</li>
</ul>
</ul>
<li><b>Monitoring Job</b></li>
<ul>
<li>In the <b>Jobs</b> view, use the <b>Runs</b> sub-tab to monitor the progress of the data load.</li></ul></ul><ol>
</ol>
<div class="separator" style="clear: both; text-align: center;"><iframe allowfullscreen="" class="BLOG_video_class" height="266" src="https://www.youtube.com/embed/kAicMSYrJmA" width="320" youtube-src-id="kAicMSYrJmA"></iframe></div><br />
<div><br /></div><div><h3>References</h3><ol><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/data-preparation.html" target="_blank">About Data Preparation (OAC)</a> (OAC)</li><li><a href="https://docs.oracle.com/en/cloud/paas/bi-cloud/bilpd/index.html">Preparing Data in Oracle Business Intelligence Cloud Service</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/manage-database-connections-data-models.html#GUID-B702A0F9-F353-493B-B61C-DB49C3C13241">Manage Database Connections for Data Models</a> (OAC)</li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/use-data-modeler.html#GUID-20C65028-74E0-4041-8877-035DC224F0EC" target="_blank">Use Data Modeler</a> (OAC)</li><li><a href="https://youtu.be/vX4BfF03C88" style="background-color: yellow;" target="_blank">Create Your Initial Data Model From Relational Sources Using Data Modeler</a> (Youtube)</li><li><a href="https://xmlandmore.blogspot.com/2019/02/oacknowing-snapshot-basics.html" target="_blank">OAC―Knowing Snapshot Basics</a> (XML and More)</li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/data-sync-reference.html" target="_blank">Data Sync Reference</a> (OAC)</li><li><a href="https://xmlandmore.blogspot.com/2011/07/book-review-of-oracle-warehouse-builder.html">Book Review: "Oracle Warehouse Builder 11g R2: Getting Started 2011" </a>(XML and More)</li><li><a href="https://www.youtube.com/watch?v=Cd2-l8iu2N4" style="background-color: yellow;" target="_blank">Getting Started with Loading Data</a> (Youtube)</li><li><a href="https://www.youtube.com/watch?v=9YOiNTlXhlA" style="background-color: yellow;" target="_blank">Oracle BICS / OAC - using Data Sync to upload data in DBCS</a> (Youtube)</li><li><a href="https://www.youtube.com/embed/PY5hdkijYto?rel=0&autoplay=1" style="background-color: yellow;" target="_blank">Get Started with Data Modeling in Oracle Analytics Cloud</a> (Youtube)</li><li><a href="https://www.oracle.com/webfolder/technetwork/tutorials/obe/cloud/bics/cleansing-data-using-datasync/cleansing-data-using-datasync.html" target="_blank">Data Preparation, Cleansing, and Transformation with Oracle BI Cloud Services Data Sync</a> (OAC Tutorial)</li><li><a href="https://blogs.oracle.com/analyticscloud/learn-modern-data-visualization-with-oracle-analytics" target="_blank">Learn Modern Data Visualization with Oracle Analytics</a></li><li>Click <a href="https://www.oracle.com/business-analytics/" target="_blank">here</a> for more A-Team Oracle Analytics (OAC) Blogs.</li></ol></div>Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com0tag:blogger.com,1999:blog-748094882401183761.post-5566767743862182742019-02-09T13:20:00.000-06:002020-01-07T15:11:26.147-06:00Oracle Certified Professional―How to Get Certified for Oracle Cloud Infrastructure<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjMKzvaWTnwyEcj1p6jYzOQnv8AdY7Kt0gE9bvAmjpy4boOHSK9F_e0Gjq9oztqrbNFjggOIsH36T0Qrd0tljzUvoLdvN1ndCaUwqxs5FVgwAUfLPU1-Ncy6LW-xZ70oYHkWKYWvejv6zeN/s1600/OCI_certification2.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="157" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjMKzvaWTnwyEcj1p6jYzOQnv8AdY7Kt0gE9bvAmjpy4boOHSK9F_e0Gjq9oztqrbNFjggOIsH36T0Qrd0tljzUvoLdvN1ndCaUwqxs5FVgwAUfLPU1-Ncy6LW-xZ70oYHkWKYWvejv6zeN/s1600/OCI_certification2.jpg" /></a></div>
<br />
Was very happy to be certified as <b>Oracle Cloud Infrastructure 2018 Certified Architect Associate</b>. Below I want to share my own experience on:<br />
<ul style="text-align: left;">
<li><b>How to prepare</b> for the certification exam (i.e. <a href="https://education.oracle.com/oracle-cloud-infrastructure-2018-architect-associate/pexam_1Z0-932" target="_blank">1Z0-932</a>)</li>
<ul>
<li><a href="https://xmlandmore.blogspot.com/2019/02/oracle-certified-professionalhow-to-get.html#ExamDetails"> Exam Details</a></li>
</ul>
<li><b>How to register</b></li>
<ul>
<li>Oracle has partnered with an external testing provider <a href="https://home.pearsonvue.com/oracle" target="_blank">PearsonVue</a></li>
</ul>
<li><b>What to expect</b> afterwards</li>
</ul>
<div>
<br /></div>
<h3>
How to Prepare </h3>
<br />
After working on <a href="https://docs.cloud.oracle.com/iaas/Content/GSG/Concepts/concepts.htm">Oracle Cloud Infrastructure</a> (<b>OCI</b>) for the past four years, I have lots of hands-on experience with it. But, based on my previous certification experience with <b>Oracle Database</b> and <b>Java</b>, I know passing the certification exam is non-trivial.<br />
<div>
<br /></div>
<div>
After reviewing <a href="https://xmlandmore.blogspot.com/2019/02/oracle-certified-professionalhow-to-get.html#ExamTopics" target="_blank">Exam Topics</a> (see below), I have picked up my old practice of documenting what I read like before. Here are the list of them on this blogger:</div>
<div>
<ul style="text-align: left;">
<li><b>Identity and Access Management</b> (IAM)</li>
<ul>
<li><a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-identity-and-access.html" target="_blank">OCI―Knowing Identity and Access Management Basics</a></li>
</ul>
<li><b>Database</b></li>
<ul>
<li><a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-database-service-basics.html" target="_blank">OCI―Knowing Database Service Basics</a></li>
<li><a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-autonomous-database-basics.html" target="_blank">OCI―Knowing Autonomous Database Basics</a></li>
</ul>
<li><b>Storage</b></li>
<ul>
<li><a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-object-storage-basics.html" target="_blank">OCI―Knowing Object Storage Basics</a></li>
<li><a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-file-storage-service-basics.html" target="_blank">OCI―Knowing File Storage Service Basics</a></li>
<li><a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-block-volume-service-basics.html" target="_blank">OCI―Knowing Block Volume Service Basics</a></li>
</ul>
<li><b>Compute</b></li>
<ul>
<li><a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-compute-service-basics.html" target="_blank">OCI―Knowing Compute Service Basics</a></li>
</ul>
<li><b>Network</b></li>
<ul>
<li><a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-virtual-cloud-network-basics.html" target="_blank">OCI―Knowing Virtual Cloud Network Basics</a></li>
<li><a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-gateway-basics.html" target="_blank">OCI―Knowing Gateway Basics</a></li>
</ul>
</ul>
</div>
<div>
<div>
<div style="box-sizing: border-box;">
<div style="box-sizing: border-box; margin: 0px 0px 1em;">
Below topics may not be that important for the certification (but, they are in the good-to-know category):<br />
<ul style="text-align: left;">
<li><a href="https://xmlandmore.blogspot.com/2019/01/oracle-cloud-infrastructurecontainer.html" target="_blank">Oracle Cloud Infrastructure―Container Engine for Kubernetes Basics</a></li>
<li><a href="https://xmlandmore.blogspot.com/2018/12/oracle-cloud-infrastructureoci-key.html" target="_blank">Oracle Cloud Infrastructure―OCI Key Management Basics</a></li>
<li><a href="https://xmlandmore.blogspot.com/2018/12/oracle-cloud-infrastructureoci-dns.html" target="_blank">Oracle Cloud Infrastructure―OCI DNS Service Basics</a></li>
<li><a href="https://xmlandmore.blogspot.com/2018/12/oracle-cloud-infrastructureoci-load.html" target="_blank">Oracle Cloud Infrastructure―OCI Load Balancing Service Basics</a></li>
</ul>
<div>
Finally, all your final understanding of OCI should be based on the official</div>
<div>
<ul style="text-align: left;">
<li><a href="https://docs.cloud.oracle.com/iaas/Content/GSG/Concepts/baremetalintro.htm" target="_blank">Oracle Cloud Infrastructure Documentation</a></li>
</ul>
</div>
<div>
<br /></div>
<div>
<b><u>Important Whitepapers</u></b></div>
<div>
<ul style="text-align: left;">
<li><a href="https://cloud.oracle.com/iaas/whitepapers/best-practices-deploying-ha-architecture-oci.pdf" target="_blank">Best Practices for Deploying High Availability Architecture on Oracle Cloud Infrastructure</a></li>
<li><a href="https://cloud.oracle.com/iaas/whitepapers/oci_security.pdf" target="_blank">Oracle Cloud Infrastructure Security</a></li>
<li><a href="https://cloud.oracle.com/iaas/whitepapers/vcn-deployment-guide.pdf" target="_blank">Virtual Cloud Network Overview and Deployment Guide</a></li>
</ul>
</div>
<div>
<br /></div>
<div>
<b><u><a href="https://www.blogger.com/null" name="ExamDetails"> Exam Details</a></u></b></div>
</div>
<div style="box-sizing: border-box; margin: 0px 0px 1em;">
<div style="box-sizing: border-box; margin: 0px 0px 1em;">
<ul style="text-align: left;">
<li><b>Duration</b>:<span style="white-space: pre;"> </span> <span style="background-color: yellow;">105 mins</span></li>
<ul>
<li>I had almost run out of time. So, don't spend too much time on any specific question which you don't have confidence with.</li>
<ul>
<li>You can mark questions for later review.</li>
</ul>
</ul>
<li><b>Number of Questions</b>:<span style="white-space: pre;"> </span><span style="background-color: yellow;">66</span></li>
<ul>
<li><u>Some of them will NOT be counted into your score</u>.</li>
<li>Half of the exam asks questions on how to provide solutions or troubleshoot issues given very detailed scenarios</li>
<ul>
<li>You need to put on thinking hat on the level of understanding similar to the above whitepapers, not just basic concepts.</li>
</ul>
</ul>
<li><b>Passing Score</b>:<span style="white-space: pre;"> </span><span style="background-color: yellow;">65 %</span></li>
</ul>
</div>
<br />
<h3>
How to Register</h3>
<br />
If you're ready to take your exam, schedule it now and pay directly with a credit card, or redeem a voucher you’ve purchased from Oracle. Either way, you'll schedule it through Oracle's external testing provider, <a href="https://home.pearsonvue.com/oracle" target="_blank">PearsonVue</a>.
<br />
<br />
If you're an Oracle Employee, you may also get a 30% discount voucher (internal <a href="https://my.oracle.com/site/ou/Certification/GetCertified/Employees/index.html#30pvtc" target="_blank">link</a>).<br />
<br />
<h3>
What to Expect After the Exam</h3>
<br />
Within 30 mins, you should be able to find out if you pass or fail the exam from <a href="https://brm-certview.oracle.com/pls/certview/ocp_interface.home" target="_blank">CertView</a>. If you pass the certification exam, you will also receive an email from <a href="https://www.youracclaim.com/users/sign_in?onboarding=true" target="_blank">Acclaim</a> (note that you need to create a new account with it) like below:</div>
<div style="box-sizing: border-box; margin: 0px 0px 1em;">
<br /></div>
<div style="box-sizing: border-box; margin: 0px 0px 1em;">
<h1 align="center" style="margin-bottom: 13.5pt; margin-left: 0in; margin-right: 0in; margin-top: 13.5pt; text-align: center;">
<span style="color: #252525; font-family: "helvetica" , sans-serif; font-size: 13.5pt;">You've
earned a badge from Oracle <o:p></o:p></span></h1>
<div align="center" class="MsoNormal" style="text-align: center;">
<img height="110" id="_x0000_i1025" src="https://images.youracclaim.com/images/0fafd8b3-452a-48e1-a1e5-296175fc5571/Oracle-Certification-badge_OC-Associate.png" style="border-style: none; border-width: 0in; height: auto; line-height: 100%; outline: none;" width="110" /><o:p></o:p></div>
<div align="center">
<table border="0" cellpadding="0" cellspacing="0" class="MsoNormalTable" style="border-collapse: collapse; mso-yfti-tbllook: 1184; width: 100%px;">
<tbody>
<tr>
<td style="padding: .25in .25in .25in .25in;"><div align="center" class="MsoNormal" style="text-align: center;">
<span class="name"><span style="color: #333333; font-family: "helvetica" , sans-serif; font-size: 11.5pt;">Oracle Cloud Infrastructure 2018 Certified
Architect Associate </span></span><span style="font-family: "helvetica" , sans-serif; font-size: 11.5pt;"><br />
<span class="issuer"><span style="color: #666666;">Issuer: Oracle </span></span><o:p></o:p></span></div>
</td>
</tr>
</tbody></table>
</div>
<div align="center" class="MsoNormal" style="text-align: center;">
<a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__www.youracclaim.com_go_M6sEXm64AVp4N984KVaTRw&d=DwMFaQ&c=RoP1YumCXCgaWHvlZYR8PZh8Bv7qIrMUB65eapI_JnE&r=6GoQX-scJAv510fHirlShpbv-8wLpmIynLTe5yq_i2w&m=1zqEbvUVjY-y1OgLHfKP3lfU2iO_obE_GOy4CmDBFwg&s=9wV5CIJes7liLSFxXZBJgmVWgb5hcgZlyTpcXox-pQs&e=" style="border-radius: 2px; display: inline-block;"><span style="background: #226a9b; border: solid #226a9b 6.0pt; color: white; font-family: "helvetica" , sans-serif; font-size: 10.0pt; padding: 0in;">Accept your badge</span></a> <o:p></o:p></div>
<div align="center" style="line-height: 10.5pt; margin: 9.0pt; text-align: center;">
<span style="color: #666666; font-family: "helvetica" , sans-serif; font-size: 9.0pt;">or
accept your badge by clicking: <br />
<span style="color: #2a709f;">https://www.youracclaim.com/go/M6sEXm688474N984KVaYOw</span>
<o:p></o:p></span></div>
</div>
</div>
</div>
<div>
<br />
<br />
<h3>
<a href="https://www.blogger.com/null" name="ExamTopics">
Exam Topics</a></h3>
<div style="-en-clipboard: true;">
<br /></div>
<div style="box-sizing: border-box;">
<h4 style="background-color: #dddddd; border-radius: 2px; box-sizing: border-box; font-size: 16px; margin-bottom: 12px; margin-top: 12px; padding: 7px 15px;">
<span style="background-color: #dddddd; border-radius: 2px; box-sizing: border-box; color: black; font-size: 16px; font-weight: bold; line-height: 1.2;">Identity and Access Management (IAM)</span></h4>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Apply core Identity and Access Management (IAM) component</span></div>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Describe resource location</span></div>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Design federation with various identity providers</span></div>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Apply IAM, governance, and security best practices</span></div>
</div>
<div style="box-sizing: border-box;">
<h4 style="background-color: #dddddd; border-radius: 2px; box-sizing: border-box; font-size: 16px; margin-bottom: 12px; margin-top: 12px; padding: 7px 15px;">
<span style="background-color: #dddddd; border-radius: 2px; box-sizing: border-box; color: black; font-size: 16px; font-weight: bold; line-height: 1.2;">Database</span></h4>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Describe OCI Database options</span></div>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Explain OCI Database Operations</span></div>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Architect HA and DR solutions</span></div>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Managing Autonomous Database</span></div>
</div>
<div style="box-sizing: border-box;">
<h4 style="background-color: #dddddd; border-radius: 2px; box-sizing: border-box; font-size: 16px; margin-bottom: 12px; margin-top: 12px; padding: 7px 15px;">
<span style="background-color: #dddddd; border-radius: 2px; box-sizing: border-box; color: black; font-size: 16px; font-weight: bold; line-height: 1.2;">Storage</span></h4>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Understand OCI Storage options</span></div>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Designing storage solutions for applications and database</span></div>
</div>
<div style="box-sizing: border-box;">
<h4 style="background-color: #dddddd; border-radius: 2px; box-sizing: border-box; font-size: 16px; margin-bottom: 12px; margin-top: 12px; padding: 7px 15px;">
<span style="background-color: #dddddd; border-radius: 2px; box-sizing: border-box; color: black; font-size: 16px; font-weight: bold; line-height: 1.2;">Compute</span></h4>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Understand compute and sizing</span></div>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Troubleshoot options using console connections and boot volume</span></div>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Architect High Availability and Disaster Recovery solutions</span></div>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Describe image options</span></div>
</div>
<div style="box-sizing: border-box;">
<h4 style="background-color: #dddddd; border-radius: 2px; box-sizing: border-box; font-size: 16px; margin-bottom: 12px; margin-top: 12px; padding: 7px 15px;">
<span style="background-color: #dddddd; border-radius: 2px; box-sizing: border-box; color: black; font-size: 16px; font-weight: bold; line-height: 1.2;">Network</span></h4>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Apply design concepts related to VCN components</span></div>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Describe Public and Private IP addresses and virtual NICs</span></div>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Apply VCN connectivity options</span></div>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Understand remote network connectivity</span></div>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Apply OCI Load Balancer concepts</span></div>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Understand OCI Edge services</span></div>
<div style="box-sizing: border-box; font-size: 14px; margin-bottom: 1em !important; margin-left: 0px; margin-right: 0px; margin-top: 0px;">
<span style="box-sizing: border-box; font-size: 14px;">Apply OCI networking best practices</span></div>
</div>
<br />
<h3>
More Reading Materials</h3>
<br />
New Book:<br />
<ul>
<li><a href="https://learning.oreilly.com/library/view/oracle-cloud-infrastructure/9781260452600/" target="_blank">Oracle Cloud Infrastructure Architect Associate All-in-One Exam Guide (Exam 1Z0-1072)</a></li>
</ul>
<br />
White Papers: <br />
<ul>
<li><a href="https://cloud.oracle.com/iaas/whitepapers/best_practices_for_dr_on_oci.pdf">OCI Disaster Recovery Best Practices</a> </li>
<li><a href="https://cloud.oracle.com/iaas/whitepapers/creating_active_directory_domain_services_in_oci.pdf">Creating Active Directory Domain Services in Oracle Cloud Infrastructure</a> </li>
</ul>
</div>
<div>
<br /></div>
<div>
Blog Posts: <br />
<ul>
<li><a href="https://blogs.oracle.com/cloud-infrastructure/multi-factor-authentication-for-oracle-cloud-infrastructure-users">Multi-Factor Authentication for Oracle Cloud Infrastructure Users</a> </li>
<li><a href="https://blogs.oracle.com/cloud-infrastructure/introducing-oracle-cloud-infrastructure-load-balancing-metrics">Introducing Oracle Cloud Infrastructure Load Balancing Metrics</a> </li>
<li><a href="https://blogs.oracle.com/cloud-infrastructure/making-it-easier-for-organizations-to-move-oracle-based-sap-applications-to-the-cloud">Making It Easier to Move Oracle-Based SAP Applications to the Cloud</a> </li>
<li><a href="https://blogs.oracle.com/cloud-infrastructure/oracle-amd-instances-outperform-and-outprice-comparable-aws-instances">Oracle AMD Instances Outperform and Outprice Comparable AWS Instances</a> </li>
<li><a href="https://blogs.oracle.com/cloud-infrastructure/oracle-cloud-simplifies-identity-management-with-enhanced-okta-support">Oracle Cloud Simplifies Identity Management with Enhanced Okta Support </a></li>
</ul>
<ul type="disc">
</ul>
<br /></div>
</div>
</div>
Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com11tag:blogger.com,1999:blog-748094882401183761.post-50839837362081747642019-02-08T10:11:00.022-06:002022-02-02T09:57:06.770-06:00OAC―Knowing Snapshot Basics<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: left;"><div dir="ltr" trbidi="on">Before you terminate your subscription of <a href="https://cloud.oracle.com/en_US/oac" target="_blank">Oracle Analytics Cloud</a> (<b>OAC</b>), take a snapshot of your system, that is, the latest <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/plan-data-model.html#GUID-10F2E272-64DC-46EA-9FF4-7889DE26880D" target="_blank">data model</a>, <a href="https://www.blogger.com/blogger.g?blogID=748094882401183761#CatalogContent" target="_blank">catalog content</a>, <a href="https://xmlandmore.blogspot.com/2019/02/oacgetting-started-with-oracle.html#ApplicationRoles" target="_blank">application roles</a>, and so on. If you subscribe to Oracle Analytics Cloud in the future, you can import content from this archive file.<sup>[1]</sup><br /><blockquote><i>If you import the snapshot through the <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/understanding-administration-pages.html" target="_blank">Service Administration Console UI</a>, it won't affect the system until you restore that snapshot. When you restore snapshot, you can select "Custom" and choose the content types you want to restore. <br /><br />If you are concerned, you can always take snapshots of your production system before restore. </i></blockquote><i></i><blockquote class="tr_bq"><i>See also: <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/download-and-upload-snapshots.html#GUID-EA2778B4-8B7C-4135-91F0-90A223A35A80">Uploading Snapshots</a> and <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/take-snapshots-and-restore-information.html#GUID-C88E3DCD-8B10-4826-B0F4-EEBCFD0A2897">Restoring from a Snapshot</a>.</i></blockquote><div class="separator" style="clear: both; text-align: center;"><br /></div><div class="separator" style="clear: both; text-align: center;"><iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen="" frameborder="0" height="315" src="https://www.youtube.com/embed/l30wsCL-vpA" title="YouTube video player" width="560"></iframe></div></div><span style="text-align: center;"><div><b><span>Video 1. </span></b><span style="text-align: left;"><span>Use Snapshots to Migrate and Restore Data in Oracle Analytics (YouTube <a href="https://www.youtube.com/watch?v=l30wsCL-vpA" target="_blank">link</a>)</span></span></div></span><div><h3>About Snapshots</h3><br />A <b>snapshot </b>captures the state of your environment at a point in time. So, you can restore the environment if something goes wrong.<br /><ul><li><b>When</b> to take a snapshot</li><ul><li>Before people start using the system</li><li>At suitable intervals afterwards</li><li>When you want to migrate your content to another cloud service</li><ul><li>For example, you might want to migrate content you created in a development or test environment to a production environment.</li></ul></ul><li><b>How </b>to generate<b> (manually vs automatically)</b></li><ul><li>You can keep <u>up to 40 snapshots online</u> and download as many as you want.</li><li>Snapshots <span style="background-color: #fcff01;"><span style="color: #800180;">don’t include data that is hosted on external data sources</span></span>.</li><li><b>Manually </b></li><ul><li>You can download and <span style="background-color: #fcff01;"><span style="color: #800180;">store snapshots on a local file system</span></span> and upload them back to your system if they’re required to restore content. </li><ul><li>The snapshot file that you download is a compressed archive file (<b>BAR file</b>).</li></ul></ul><li><b>Automatically</b></li><ul><li>OAC <span style="background-color: #fcff01;"><span style="color: #800180;">automatically takes a snapshot when someone publishes changes to the data model</span></span> and keeps the <b>5 most recent snapshots</b> in case you unexpectedly need to revert to an earlier model version. </li><li>The minimum interval between these automatically generated snapshots is one hour.</li></ul></ul></ul></div></div><div class="separator" style="clear: both; text-align: center;"><iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen="" frameborder="0" height="315" src="https://www.youtube.com/embed/RS83uUmZGss" title="YouTube video player" width="560"></iframe></div><div><div class="separator" style="clear: both; text-align: center;"><span><b>Video 2. </b>Get Started with Data Modeling in Oracle Analytics Cloud (YouTube <a href="https://www.youtube.com/watch?v=RS83uUmZGss" target="_blank">link</a>)</span></div><div class="separator" style="clear: both; text-align: center;"><b><span style="font-size: x-small;"><br /></span></b></div><div class="separator" style="clear: both; text-align: center;"><b><span style="font-size: x-small;"><br /></span></b></div><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj4OmnCWPQAQ7Vxw_v7OqilcJxw2yeVD52KWYxJPGD2xKHI5LB9VWgV7BdavAELusCu7aofv6te6kjTp6rXZaPHrSXbQ_pUFruYSfa1mhSZg91ac60ThomsEB1FfLokN7CR1Ic_gnwZS0pW/s1600/DataModelObjects.jpg" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="728" data-original-width="807" height="504" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj4OmnCWPQAQ7Vxw_v7OqilcJxw2yeVD52KWYxJPGD2xKHI5LB9VWgV7BdavAELusCu7aofv6te6kjTp6rXZaPHrSXbQ_pUFruYSfa1mhSZg91ac60ThomsEB1FfLokN7CR1Ic_gnwZS0pW/s640/DataModelObjects.jpg" width="560" /></a></div><div class="separator" style="clear: both; text-align: center;"><b><span>Figure 1. </span></b><span style="text-align: left;"><span>Creating fact tables, dimension tables, and joins to be used in data model</span></span></div><br /><h3>Details of Snapshot Content</h3><br />When you take a snapshot you <b>choose the content you want to include in it</b>. You can take a snapshot of your entire environment (everything) or specify only specific content that you want to back up or migrate (custom).<br /><ul id="GUID-F927C179-C787-4305-9F3D-7D7BC3F5524D__UL_E2X_YZJ_1GB" style="box-sizing: border-box; margin-bottom: 0px; margin-top: 0px;"><li><b>Data</b>―Data visualization content that users create (Data tab). </li><ul><li style="box-sizing: border-box;"><b>Data Sets</b></li><ul><li style="box-sizing: border-box;"><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/add-data-sets.html" target="_blank">Data sets</a> are file–based storage objects that you can use to analyze data quickly. </li><ul><li style="box-sizing: border-box;"><span style="color: #800180;"><a href="https://www.youtube.com/embed/Cd2-l8iu2N4?rel=0&autoplay=1" style="background-color: yellow;" target="_blank">Data Sync</a></span> can load your data as a <b>data set</b> that <b>Data Visualization</b> understands.</li></ul><ul><li style="box-sizing: border-box;">When you use Data Sync to load data, you specify the target format as either relational or data set. </li></ul><li style="box-sizing: border-box;">You can use the Data Sets page to:</li><ul><li style="box-sizing: border-box;">Examine data set properties</li><li style="box-sizing: border-box;">Change column properties such as the aggregation type</li><li style="box-sizing: border-box;">Set permissions</li><li style="box-sizing: border-box;">Delete data sets that you no longer need to free up space. </li></ul></ul></ul></ul><ul id="GUID-F927C179-C787-4305-9F3D-7D7BC3F5524D__UL_P2X_C1K_1GB" style="box-sizing: border-box; margin-bottom: 0px; margin-top: 0px;"><ul><li style="box-sizing: border-box;"><b>File-based Data</b></li><ul><li style="box-sizing: border-box;">File-based data that users upload to create data sets. For example, data uploaded from a <b>spreadsheet</b>.</li></ul></ul></ul><ul id="GUID-F927C179-C787-4305-9F3D-7D7BC3F5524D__UL_WGC_41K_1GB" style="box-sizing: border-box; margin-bottom: 0px; margin-top: 0px;"><ul><li style="box-sizing: border-box;"><b><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/add-data-sources-analyze-and-explore-data-acubi.html" target="_blank">Connections</a></b></li><ul><li style="box-sizing: border-box;">Data connections can be used for <a href="https://docs.oracle.com/middleware/12213/biee/BIVUG/toc.htm" target="_blank">DV</a> data sets.</li><li style="box-sizing: border-box;">For example, you can connect Oracle Analytics Cloud to the Autonomous Data Warehouse.<sup>[16]</sup></li></ul></ul></ul><ul id="GUID-F927C179-C787-4305-9F3D-7D7BC3F5524D__UL_QGC_52J_CGB" style="box-sizing: border-box; margin-bottom: 0px; margin-top: 0px;"><ul><li style="box-sizing: border-box;"><b>Connection Parameters</b></li><ul><li style="box-sizing: border-box;">Connection parameters, such as host, port, user name, and password.</li><li style="box-sizing: border-box;">If you <b>exclude the parameter information</b>, you <span style="background-color: #fcff01;"><span style="color: #800180;">must reconfigure the connection details after you restore the snapshot</span></span>.</li></ul></ul></ul><ul id="GUID-F927C179-C787-4305-9F3D-7D7BC3F5524D__UL_GZF_Y2J_CGB" style="box-sizing: border-box; margin-bottom: 0px; margin-top: 0px;"><ul><li style="box-sizing: border-box;"><b><a href="https://www.youtube.com/watch?v=ti7DtkTlGVo" style="background-color: yellow;" target="_blank">Data Flows</a></b></li><ul><li style="box-sizing: border-box;">Enable you to organize and integrate your data to produce a curated set of data that you use in visualizations.</li><li style="box-sizing: border-box;">You can <b>curate data </b>from <span style="background-color: #fcff01;"><span style="color: #800180;">data sets, <a href="https://docs.oracle.com/en/cloud/saas/financials/19a/occar/subject-areas-for-analytics.html#OCCAR1351927" target="_blank">subject areas</a>, or database connections</span></span>.</li><li style="box-sizing: border-box;">You use the data flow editor to apply transformations, add joins and filters, remove unwanted columns, add new derived measures, add derived columns, and add other operations. </li></ul></ul></ul><ul id="GUID-F927C179-C787-4305-9F3D-7D7BC3F5524D__UL_VFS_Y2J_CGB" style="box-sizing: border-box; margin-bottom: 0px; margin-top: 0px;"><ul><li style="box-sizing: border-box;"><b><a href="https://www.youtube.com/watch?time_continue=2&v=-Yp5tVFQFCk" style="background-color: yellow;" target="_blank">Sequences</a></b></li><ul><li style="box-sizing: border-box;">A <b>sequence </b>is a <span style="background-color: #fcff01;"><span style="color: #800180;">saved sequential list of specified data flows</span></span> and is useful when you want to run multiple data flows <b>as a single transaction</b>. </li><li style="box-sizing: border-box;"><b>If any flow within a sequence fails</b>, then all the changes done in <span style="background-color: #fcff01;"><span style="color: #800180;">the sequence are rolled back</span></span>.</li></ul><li><b>Data Replications</b></li><ul><li>You can duplicate an uploaded data set that is listed in the Data Sets page to help you further curate (organize and integrate from various sources) data in projects.</li></ul></ul><li><b>Classic Content</b>―Created using Classic tools in Oracle Analytics Cloud, such as <b>analyses, dashboards, and pixel-perfect reports</b>.</li></ul><ul id="GUID-F927C179-C787-4305-9F3D-7D7BC3F5524D__UL_E1D_DFJ_CGB" style="box-sizing: border-box; margin-bottom: 0px; margin-top: 0px;"><ul><li style="box-sizing: border-box;"><b><a href="https://youtu.be/tbK_BbgIK3U" style="background-color: yellow;" target="_blank">Data Model</a> and <a href="https://docs.oracle.com/en/cloud/saas/financials/19a/occar/subject-areas-for-analytics.html#OCCAR1351927" target="_blank">Subject Areas</a></b></li><ul><li style="box-sizing: border-box;">You build a model of your business data to enable analysts to structure queries in the same intuitive fashion as they ask business questions (watch <a href="https://www.youtube.com/watch?v=RS83uUmZGss&t=0s" style="background-color: yellow;" target="_blank">video</a>).</li><li style="box-sizing: border-box;"><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/model-data-for-reports.html" target="_blank">Data Modeler</a> enables you to model the data that is needed to produce reports.</li><ul><li style="box-sizing: border-box;">Data model objects include fact tables, <a href="https://en.wikipedia.org/wiki/Dimension_(data_warehouse)" target="_blank">dimension</a> tables, hierarchies, fact columns, and dimension columns.</li><li style="box-sizing: border-box;">For example, you can create your initial data model from relational sources using data modeler (watch <a href="https://www.youtube.com/watch?v=RS83uUmZGss&t=0s" style="background-color: yellow;" target="_blank">video</a>).</li></ul><li style="box-sizing: border-box;">When you create an <a href="https://www.oracle.com/webfolder/technetwork/tutorials/obe/cloud/bics/CreateAnalyses/CreateAnalyses.html" target="_blank">analysis</a>, you first select a <a href="https://docs.oracle.com/en/cloud/saas/financials/19a/occar/subject-areas-for-analytics.html#OCCAR1351927" target="_blank">subject area</a>, which contains columns related to a specific business object or area. Then, open <a href="https://docs.oracle.com/en/cloud/saas/financials/19a/occar/subject-areas-for-analytics.html#OCCAR1351927" target="_blank">folders</a> within the subject area to find the columns to include.</li></ul></ul></ul><ul id="GUID-F927C179-C787-4305-9F3D-7D7BC3F5524D__UL_OHQ_DFJ_CGB" style="box-sizing: border-box; margin-bottom: 0px; margin-top: 0px;"><ul><li style="box-sizing: border-box;"><b><a href="https://www.blogger.com/null" name="CatalogContent">Catalog Content</a></b></li><ul><li style="box-sizing: border-box;">Catalog containing content that users create and save for future use, such as analyses, dashboards, reports, deliveries, agents, and so on.</li><li style="box-sizing: border-box;">You can use the Catalog page to locate objects in the catalog and perform tasks specific to those objects. </li><ul><li style="box-sizing: border-box;">For example, you can <b>search</b> for <u>analyses</u>, <u>dashboards</u>, or <u>projects </u>by name (full or partial) and by folder location</li></ul></ul></ul></ul><ul id="GUID-F927C179-C787-4305-9F3D-7D7BC3F5524D__UL_TL1_2FJ_CGB" style="box-sizing: border-box; margin-bottom: 0px; margin-top: 0px;"><ul><li style="box-sizing: border-box;"><b>Shared Folders and Projects</b></li><ul><li style="box-sizing: border-box;">Content that is being shared, that is, content that everyone with access to Classic tools can see.</li><li style="box-sizing: border-box;">This includes any data visualization projects saved in the shared folders.</li><ul><li style="box-sizing: border-box;">A <b>project </b>is a <span style="background-color: #fcff01;"><span style="color: #800180;">work space defines and organizes source files, relational tables, target tables and indices</span></span>.</li></ul></ul></ul></ul><ul id="GUID-F927C179-C787-4305-9F3D-7D7BC3F5524D__UL_KFQ_2FJ_CGB" style="box-sizing: border-box; margin-bottom: 0px; margin-top: 0px;"><ul><li style="box-sizing: border-box;"><b>User Folders and Projects</b></li><ul><li style="box-sizing: border-box;">Content stored in user folders. Content that users create and store for their private use.</li><li style="box-sizing: border-box;">This includes any data visualization projects users saved in their private folders.</li></ul></ul><li><b><a href="https://blogs.oracle.com/analyticscloud/machine-learning" target="_blank">Machine Learning</a></b><span style="white-space: pre;"> </span></li><ul><li>Machine learning models that users create from <a href="https://www.youtube.com/watch?v=ti7DtkTlGVo" style="background-color: yellow;" target="_blank">data flows</a>.</li><li>Machine learning analyzes the data in your data set to provide insights that enable you to explain the various aspects of that data.</li></ul><li><b>Jobs</b><span style="white-space: pre;"> </span></li><ul><li>Jobs that users <b>schedule </b>for data flows, sequences, data replications, and pixel-perfect reports.</li></ul><li><b>Plug-ins and Extensions<span style="white-space: pre;"> </span></b></li><ul><li>Extensions that users upload to implement custom visualizations and custom maps.</li></ul><li><b>Configuration and Settings</b><span style="white-space: pre;"> </span></li><ul><li>Service configuration and settings configured through Console. </li><ul><li>For example, mail settings, database connections, <a href="https://docs.oracle.com/en/cloud/paas/bi-cloud/bilpd/whitelisting-safe-domains.html" target="_blank">safe domains</a>, and more.</li></ul></ul><li><a href="https://xmlandmore.blogspot.com/2019/02/oacgetting-started-with-oracle.html#ApplicationRoles" target="_blank"><b>Application Roles</b></a><span style="white-space: pre;"> </span></li><ul><li>Custom application roles administrators create through Console.</li></ul></ul><br /><br /><h3>References</h3><ol><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/top-faqs-manage-my-service.html" target="_blank"></a><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/top-faqs-manage-my-service.html" target="_blank"></a><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/top-faqs-manage-my-service.html" target="_blank">Top FAQs to Manage Oracle Analytics Cloud</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/snapshots.html#GUID-FAE709DE-3370-457C-9015-2E088ACA6181" target="_blank">About Snapshots</a> (OAC)</li><li><a href="http://www.ateam-oracle.com/category/cloud/paas/paas-bics/">Oracle A-Team Chronicles for BICS</a></li><li><a href="http://www.ateam-oracle.com/category/cloud/paas/oracle-analytics-cloud-service/">Oracle A-Team Chronicles for OAC</a></li><li><a href="https://docs.oracle.com/middleware/bi12214/biee/BIESG/GUID-FF29B794-97F5-4975-A924-ED40319B9150.htm#BIESG1375">Configuring and Managing the OAC Catalog.</a></li><li><a href="https://www.oracle.com/technetwork/middleware/oac/downloads/oac-tools-4392272.html">Developer Client Tool for OAC </a></li><li><a href="https://www.oracle.com/technetwork/middleware/bi-enterprise-edition/downloads/default-4441820.html">Oracle Business Intelligence Developer Client Tool</a></li><li><a href="https://docs.oracle.com/middleware/bi12214/biee/BIESG/GUID-FF29B794-97F5-4975-A924-ED40319B9150.htm#BIESG2906">Opening an Oracle BI Presentation Catalog</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/take-snapshots-and-restore-information.html#GUID-C7DE34A5-7A67-4415-98B7-1CA9E5235480">Take a Snapshot</a> (OAC)</li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/download-and-upload-snapshots.html#GUID-F0FE4E2F-8D8F-4EBF-B1CC-21DDA689D3A5">Download Snapshots</a> (OAC)</li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/migrate-content-other-catalogs.html#GUID-21B10406-0764-4046-B80C-0212DB3BDBF6">Save Content to a Catalog Archive</a> (OAC)</li><li><a href="https://docs.oracle.com/middleware/bi12214/biee/BIEUG/GUID-5E1F2DFE-794A-455F-AEA3-B4C1DD6234BB.htm#BIEUG10769">Permission Definitions</a> (OAC)</li><li><a href="https://docs.oracle.com/middleware/bi12214/biee/BIESG/GUID-FF29B794-97F5-4975-A924-ED40319B9150.htm#BIESG3595">Unarchiving a Folder Using Catalog Manager</a> (OAC)</li><li><a href="https://docs.oracle.com/middleware/bi12214/biee/BIESG/GUID-FF29B794-97F5-4975-A924-ED40319B9150.htm#BIESG3594">Archiving a Folder Using Catalog Manager</a> (OAC)</li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/migrate-content-other-catalogs.html#GUID-1E5DB720-1334-4DBE-8F1D-CE0E339B42A2">Upload Content from a Catalog Archive</a> (OAC)</li><li><a href="http://www.ateam-oracle.com/connecting-oracle-analytics-cloud-version-5-to-the-autonomous-data-warehouse/" target="_blank">Connecting Oracle Analytics Cloud Version 5. x to the Autonomous Data Warehouse</a></li><li><a href="https://docs.oracle.com/middleware/12213/biee/BIVUG/toc.htm" target="_blank">Fusion Middleware User's Guide for Oracle Data Visualization</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/understand-data-modeling.html" target="_blank">Understand Data Modeling</a> (OAC)</li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/preparing-data-oracle-analytics-cloud.pdf" target="_blank">Oracle® CloudPreparing Data in Oracle Analytics Cloud</a> (PDF) </li><li><a href="https://docs.oracle.com/en/cloud/saas/financials/19a/occar/subject-areas-for-analytics.html#OCCAR1351927" target="_blank">Subject Areas for Analytics</a> (OAC)</li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/use-data-modeler.html#GUID-20C65028-74E0-4041-8877-035DC224F0EC" target="_blank">Use Data Modeler</a> (OAC)</li><li><a href="https://youtu.be/RS83uUmZGss" style="background-color: yellow;" target="_blank">Get Started with Data Modeling in Oracle Analytics Cloud</a> (Youtube)</li><li><a href="https://www.youtube.com/watch?v=MrQM3Q_bkzw" style="background-color: yellow;" target="_blank">Machine Learning with Oracle Analytics Cloud</a> (Youtube)</li><li><a href="https://blogs.oracle.com/analyticscloud/learn-modern-data-visualization-with-oracle-analytics" target="_blank">Learn Modern Data Visualization with Oracle Analytics</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/add-data-sets.html" target="_blank">Add Data Sets</a> (<a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acubi/introduction-visualization-and-reporting.html" target="_blank">Visualization and Reporting in Oracle Analytics Cloud</a>)</li><li><a href="https://www.oracle.com/webfolder/technetwork/tutorials/obe/cloud/bics/CreateAnalyses/CreateAnalyses.html" target="_blank">Creating Analyses in Oracle BI Cloud Service</a> (Oracle By Example)</li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acmgp/migrate-your-oracle-analytics-cloud-classic-instances.html" target="_blank">Migrating Oracle Analytics Cloud - Classic Instances to Oracle Cloud Infrastructure</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/get-started-configuration.html" target="_blank">Configuring Oracle Analytics Cloud</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acoci/manage-service-access-and-security.html#GUID-C13DE22F-5069-4704-B64E-2F6D28B8D027" target="_blank">Give Data Sources Access to Analytics Cloud Instances</a></li><li><a href="https://www.youtube.com/watch?v=jZMIfd4gAL0" style="background-color: #fcff01;" target="_blank">OAC 10.5.1 : Content Migration Using Manual Utility</a> (Youtube)</li><li><a href="https://docs.oracle.com/en/middleware/bi/analytics-server/security-oas/managing-security-oracle-analytics-server.pdf" target="_blank">Oracle Analytics Managing Security for Oracle Analytics Server, 5.9.0</a> (pdf)</li><li><a href="https://www.oracle.com/business-analytics/data-visualization/library-overview.html" target="_blank">Oracle analytics library</a> (good)</li></ol></div></div>Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com3tag:blogger.com,1999:blog-748094882401183761.post-39639211035812376062019-02-06T10:55:00.028-06:002022-06-29T10:16:52.296-05:00OAC―Getting Started with Oracle Analytics Cloud
<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;"><iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen="" frameborder="0" height="315" src="https://www.youtube.com/embed/hRi0yQZNPpA" title="YouTube video player" width="560"></iframe>
</div><div style="text-align: center;"><span><b>Video 1.</b> Announcing new Oracle Analytics Cloud innovations (YouTube <a href="https://www.youtube.com/watch?v=hRi0yQZNPpA" target="_blank">link</a>)</span></div><div dir="ltr" style="text-align: left;" trbidi="on"><div>
<br /></div>
</div>
<div class="separator" style="clear: both; text-align: center;"><iframe width="560" height="315" src="https://www.youtube.com/embed/q0A9nKF2Vrs" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe></div><div class="separator" style="clear: both; text-align: center;"><span><b>Video 2. Announcing new Oracle Analytics Cloud innovations highlights </b></span></div><div class="separator" style="clear: both; text-align: center;"><span><b>(05/03/2021; YouTube <a href="https://www.youtube.com/watch?v=q0A9nKF2Vrs" target="_blank">link</a>)</b></span></div><div><br /></div><a href="https://cloud.oracle.com/en_US/oac" target="_blank">Oracle Analytics Cloud</a> (<b>OAC</b>) is a scalable and secure public cloud service that provides a full set of capabilities to explore and perform collaborative analytics for you, your workgroup, and your enterprise.<br /><br />With OAC you also get flexible service management capabilities, including fast setup, easy scaling and patching, and automated lifecycle management.<br /><br />In this article, we will get you started with OAC in the following areas:<br /><ul><li><b>Features of OAC from Data-Centric and Data-Driven Perspectives</b></li><li><b>Options to Plot Your Journeys to OAC</b></li><li><b>Pre-defined Roles to Manage Your Data Assets and Applications</b></li></ul><br />If you are interested in deploying OAC in Oracle Cloud and would like to start learning it, you can begin with:<br /><blockquote class="tr_bq"><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/get-started-data-preparation-oracle-analytics-cloud.html" target="_blank">Get Started with Data Preparation in Oracle Analytics Cloud</a></blockquote><br /><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEihKysHowQ5y3iQJGrHKT-NhRjMSd9kXSdcra3ReiiYjcGHo9Z1Td-7AlVZySFO5M0Q-JXsd94Dc6C5gz39p39QA3r46El0jVu-4ChiCpx7c1stk0nCsof54_S6xunYdBoHq1Xe1OSsSYu-/s1600/OAC_architecture.jpg" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="900" data-original-width="1600" height="315" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEihKysHowQ5y3iQJGrHKT-NhRjMSd9kXSdcra3ReiiYjcGHo9Z1Td-7AlVZySFO5M0Q-JXsd94Dc6C5gz39p39QA3r46El0jVu-4ChiCpx7c1stk0nCsof54_S6xunYdBoHq1Xe1OSsSYu-/s640/OAC_architecture.jpg" width="560" /></a></div><br /><br /><h3>Features of OAC</h3><br />Built on a high-performance platform with flexible data storage, <a href="https://www.oracle.com/business-analytics/analytics-cloud.html" target="_blank">Oracle Analytics Cloud</a> provides a complete set of tools for deriving and sharing data insights:<sup>[1]</sup><br /><ul><li><b>Data collection</b></li><ul><li>Data connectors are available for a wide array of sources, Oracle and non-Oracle. In addition to native connectors, OAC supports open ODBC and <a href="https://docs.oracle.com/en/database/oracle/oracle-database/21/jjdbc/introducing-JDBC.html" target="_blank">JDBC</a>.</li></ul><li><b>Data</b> <b>preparation</b></li><ul><li>Analysts can ingest, profile, and cleanse data using a variety of algorithms. </li></ul><li><b>Data flow</b></li><ul><li>Analysts can prepare, transform and aggregate data, and then run machine-learning models at scale. </li></ul><li><b>Data discovery</b></li><ul><li>Subject matter experts can easily collaborate with other business users, blending intelligent analysis at scale, machine learning, and statistical modeling. </li></ul><li><b>Data visualization</b></li><ul><li>Analysts can visualize any data, on any device, on premises and in the cloud. </li></ul><li><b>Data collaboration</b></li><ul><li>Large organizations and small teams can share data more simply, without the need to manage or consolidate multiple versions of spreadsheets, and quickly perform ad hoc analysis of the spreadsheet data.</li></ul><li><b>Data-driven</b></li><ul><li>Application developers can utilize interfaces that enable them to extend, customize, and embed rich analytic experiences in the application flow. </li></ul></ul>With Oracle Analytics Cloud, you can take data from any source, and explore and collaborate with <b>real-time data</b>.<br /><br /><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj0Y3WhB4In9gmlcmBBbSVDMGe80D74jEI-MycMQ9p83P_CJDf5pBg8UrVtVGWkTTmo3lA279ErfN0nI9mtvUXf6EFOzxqbfiJ2W4xzvlU7JyOF61CeqJez3S8yi0SZUlamGtcpBksK3dOX/s1600/OAC_Modes.jpg" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="558" data-original-width="644" height="484" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj0Y3WhB4In9gmlcmBBbSVDMGe80D74jEI-MycMQ9p83P_CJDf5pBg8UrVtVGWkTTmo3lA279ErfN0nI9mtvUXf6EFOzxqbfiJ2W4xzvlU7JyOF61CeqJez3S8yi0SZUlamGtcpBksK3dOX/s640/OAC_Modes.jpg" width="560" /></a></div><br /><br /><h3>Migration Options</h3><br />To help you plotting your journey to OAC, Oracle offers a range of options to existing Oracle BI Enterprise Edition, Oracle BI Applications, and Oracle Essbase customers:<br /><ul><li><b>Cloud First</b></li><li><b>Cloud @ Customer</b></li><li><b>Keep and Connect</b></li><li><b>Keep and Combine</b></li><li><b>Lift and Shift</b><sup>[14]</sup></li></ul><br />To view the details of each option, you can: read<br /><blockquote class="tr_bq"><a href="https://www.oracle.com/webfolder/s/assets/ebook/analytics-cloud-investment-plan/index.html#/page/25" target="_blank">Plotting your journey to the Cloud</a> </blockquote><br /><h3>Users, Roles and Application Roles<sup>[22,23]</sup></h3><div><br /></div>Most administrators set up <b>user accounts</b> and give people access to OAC through <b>roles</b> (also known as, <b>user groups</b>). The way you do this depends whether you manage users through<br /><div><ul style="text-align: left;"><li><a href="https://docs.oracle.com/en/cloud/paas/identity-cloud/index.html" target="_blank">Oracle Identity Cloud Service</a> (<b>IDCS</b>) </li><li><a href="https://docs.oracle.com/cd/E24329_01/web.1211/e24422/ldap.htm#SECMG327" target="_blank">WebLogic embedded LDAP server</a></li><ul><li>Oracle<span style="background-color: #fcff01; color: #800180;"> doesn't recommend</span> using WebLogic LDAP Server in an environment <span style="background-color: #fcff01; color: #800180;">with more than 1,000 users</span>. If you need a production environment with high-availability and scalability, then use a directory service such as Oracle Internet Directory or a third-party
directory service.<sup>[22]</sup></li><li>If you have an existing service that uses WebLogic embedded LDAP server for identity management, you can use various export and import utilities to migrate your artifacts to another Oracle Analytics Cloud - Classic environment that uses Oracle Identity Cloud Service (see <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsam/set-services.html#GUID-889E2C93-0631-4F6A-80E7-FEE0E4361817" target="_blank">document</a>).</li></ul></ul></div><div><div>To explain user roles and privileges, here we will use <a href="https://docs.oracle.com/en/cloud/paas/identity-cloud/index.html" target="_blank">IDCS</a> for illustration and start with <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/application-roles.html#GUID-79B74036-BF0D-4BD4-AE4E-0017E2D84DC8" target="_blank">application role</a> first.</div><div><br /></div><div><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/application-roles.html#GUID-79B74036-BF0D-4BD4-AE4E-0017E2D84DC8" name="ApplicationRoles"><b><u>Application Role</u></b></a></div></div><div><br /></div>An <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/application-roles.html#GUID-79B74036-BF0D-4BD4-AE4E-0017E2D84DC8" target="_blank">application role</a> comprises a set of <b>privileges </b>that determine what users can see and do after signing in to OAC. It’s your job as an administrator (i.e., who created the service) to assign people to one or more application roles.<br /><div><br /></div><div>OAC provides several predefined application roles to get you started. In many cases, these predefined application roles are all that you need. Note that you can’t delete predefined application roles or remove <a href="https://docs.oracle.com/en/middleware/bi/analytics-server/security-oas/manage-application-roles.html#GUID-3CEED4DB-F124-45AF-A115-75AF7392974C" target="_blank">default memberships</a>.<br /><div><br /></div><div><table border="2" cellpadding="0" cellspacing="0" style="border-collapse: collapse; width: 468.364px;"><tbody><tr height="20" style="height: 15pt;"><td class="xl65" height="20" style="border-color: currentcolor rgb(169, 208, 142) rgb(169, 208, 142); height: 15pt; width: 114pt;" width="152"><b><span style="color: #cc6600;">Application Role in OAC</span></b></td><td class="xl65" style="border-color: currentcolor; border-left-style: none; border-left-width: initial; text-align: center; width: 437pt;" width="582"><b><span style="color: #cc6600;"> Description</span></b></td></tr><tr height="20" style="height: 15pt;"><td class="xl66" height="20" style="border-top: none; height: 15pt; width: 114pt;" width="152">BI Service Administrator </td><td class="xl66" style="border-left: none; border-top: none; width: 437pt;" width="582"> Allows users to administer OAC and delegate privileges to others using the Console</td></tr><tr height="20" style="height: 15pt;"><td class="xl67" height="20" style="border-top: none; height: 15pt; width: 114pt;" width="152">BI Data Model Author </td><td class="xl67" style="border-left: none; border-top: none; width: 437pt;" width="582"> Allows users to manage data models in OAC using Data Modeler</td></tr><tr height="20" style="height: 15pt;"><td class="xl66" height="20" style="border-top: none; height: 15pt; width: 114pt;" width="152">BI Data Load Author </td><td class="xl66" style="border-left: none; border-top: none; width: 437pt;" width="582"> Allows users to load data using REST APIs and <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/quick-guide-load-data-data-sync.html#GUID-826A39C4-C739-4113-94AC-FB498A232BD8" target="_blank">Data Sync</a></td></tr><tr height="20" style="height: 15pt;"><td class="xl67" height="20" style="border-top: none; height: 15pt; width: 114pt;" width="152">BI Content Author </td><td class="xl67" style="border-left: none; border-top: none; width: 437pt;" width="582"> Allows users to create analyses and dashboards in OAC and share them with others</td></tr><tr height="39" style="height: 29.4pt;"><td class="xl66" height="39" style="border-top: none; height: 29.4pt; width: 114pt;" width="152">DV Content Author </td><td class="xl66" style="border-left: none; border-top: none; width: 437pt;" width="582"> Allows users to create visualization projects, load data for data visualizations, and explore data visualizations</td></tr><tr height="20" style="height: 15pt;"><td class="xl67" height="20" style="border-top: none; height: 15pt; width: 114pt;" width="152">DV Consumer </td><td class="xl67" style="border-left: none; border-top: none; width: 437pt;" width="582"> Allows users to explore data visualizations</td></tr><tr height="20" style="height: 15pt;"><td class="xl66" height="20" style="border-top: none; height: 15pt; width: 114pt;" width="152">BI Consumer </td><td class="xl66" style="border-left: none; border-top: none; width: 437pt;" width="582"> Allows users to view and run reports in OAC</td></tr></tbody></table></div><div></div><br />Oracle Analytics Cloud is federated with Oracle Identity Cloud Service and initially offers a single user account (i.e., the user who creates the service) and several predefined application roles (note that these <span style="background-color: #fcff01; color: #800180;">roles in IDCS are different from application roles defined in OAC</span>). Below diagram shows how application roles defined in IDCS are mapped to the ones defined in OAC.</div><div><br /></div><div>For example, <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/users-and-groups.html#GUID-811DEC21-ECF8-4E98-86F3-8BC2088A11A4" target="_blank">ServiceAdministrator</a><b> </b>is the application role defined in IDCS, which is<br /><ul><li>Member of <b>BI Service Administrator</b>, <b>BI Data Model Author</b>, and <b>BI Data Load Author</b>.</li><ul><li>Allows users to administer OAC and delegate privileges to others.</li><li>The user who creates the service is automatically assigned this Oracle Identity Cloud Service application role.</li></ul></ul>So, instead of dealing with <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/application-roles.html#GUID-79B74036-BF0D-4BD4-AE4E-0017E2D84DC8" target="_blank">application roles</a> defined in OAC, you assign roles defined in IDCS to users.</div><div><br /><br /><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgGE2wdqfSLJlkSCWTMUt-oahatTsG_SP5-Y8ucl3pQP8sS8D9H3oCO5Tb5U420BslKPHIkt2l_1W-KYxkrNWR5UTdEHZXAB5_bQbCJ5sr6Zu_TsVcMmAr3qg0UOZYv1iywjyAcG6NlmqjB/s1600/OAC_Application_Roles.jpg" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="370" data-original-width="821" height="252" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgGE2wdqfSLJlkSCWTMUt-oahatTsG_SP5-Y8ucl3pQP8sS8D9H3oCO5Tb5U420BslKPHIkt2l_1W-KYxkrNWR5UTdEHZXAB5_bQbCJ5sr6Zu_TsVcMmAr3qg0UOZYv1iywjyAcG6NlmqjB/s640/OAC_Application_Roles.jpg" width="560" /></a></div><br /><br />To learn more about <a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/manage-what-users-can-see-and-do.html" target="_blank">Users, Roles, and Application Roles</a> defined in OAC, you can watch below video and <span style="background-color: #fcff01; color: #800180;">learn more details</span> from [8, 22, 23]:<br /><div class="separator" style="clear: both; text-align: center;"><br /></div><div class="separator" style="clear: both; text-align: center;"><iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen="" frameborder="0" height="315" src="https://www.youtube.com/embed/QsY3MsrasHo" title="YouTube video player" width="560"></iframe></div><div class="separator" style="clear: both; text-align: center;"><span><b>Video 3. </b>Manage What Users Can See and Do in Oracle Analytics (YouTube <a href="https://www.youtube.com/results?search_query=oracle+analytics+Users%2C+Roles%2C+and+Application+Roles" target="_blank">link</a>)</span></div><br /><blockquote class="tr_bq"></blockquote><h3></h3><h3>References</h3><ol><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/index.html" target="_blank">Oracle® Cloud Getting Started with Oracle Analytics Cloud</a> (<a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsgs/getting-started-oracle-analytics-cloud.pdf" target="_blank">pdf</a>)</li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/videos.html" target="_blank">Videos</a> (OAC)</li><li><a href="https://www.oracle.com/solutions/business-analytics/resources.html#white-paper" target="_blank">Resources</a> (OAC)</li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/books.html" target="_blank">Books</a> (OAC)</li><li>Migrating Artifacts from Oracle BI Applications to Oracle Analytics Cloud (OAC) (<a href="https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=322722621450122&id=2290664.1&_afrWindowMode=0&_adf.ctrl-state=10xdxctwgw_4" target="_blank">Doc ID 2290664.1</a>)</li><li>OBIA 11g: Oracle BI Applications Installation on PaaS with Oracle Analytics Cloud (OAC) (<a href="https://support.oracle.com/epmos/faces/DocumentDisplay?_afrLoop=322880294984928&id=2254057.1&_afrWindowMode=0&_adf.ctrl-state=10xdxctwgw_53" target="_blank">Doc ID 2254057.1)</a></li><li><a href="https://learn.oracle.com/pls/web_prod-plq-dad/dl4_pages.getpage?page=dl4consumption&get_params=offering:37193,container:37567#" style="background-color: yellow;" target="_blank">Essentials: Business Analytics</a> (Oracle University)</li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/manage-what-users-can-see-and-do.html" target="_blank">Manage What Users Can See and Do</a> (OAC)</li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/get-started-data-preparation-oracle-analytics-cloud.html" target="_blank">Get Started with Data Preparation in Oracle Analytics Cloud</a> (documentation)</li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/quick-guide-load-data-data-sync.html#GUID-826A39C4-C739-4113-94AC-FB498A232BD8" target="_blank">Quick Guide to Loading Data With Data Sync</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/frequently-asked-questions.html" target="_blank">Frequently Asked Questions</a> (OAC)</li><li><a href="https://www.oracle.com/africa/events/live/analytics-innovations/?source=:ow:o:p:po:::Cloud&intcmp=:ow:o:p:po:::Cloud" style="background-color: #fcff01;" target="_blank">Oracle Live: Announcing New Oracle Analytics Cloud Innovations</a> (05/03/2021)</li><li><a href="https://docs.oracle.com/en/cloud/paas/bi-cloud/bilpd/functionality-enabled-application-roles.html" target="_blank">Application Role by Functionality</a> (OBICS)</li><li><a href="https://blogs.oracle.com/biapps/biapps_lift_shift_to_oac" target="_blank">Lift and Shift of Oracle BIAPPS Artifacts to Oracle Analytics Cloud</a> (Oracle BI Applications Blog)</li><li><a href="https://www.oracle.com/a/ocom/docs/corporate/analystrelations/451research-oracle-analytics-cloud.pdf" target="_blank">Oracle illuminates itsAnalytics Cloud: The sleepinggiant awakens</a> (451 Research)</li><li><a href="https://blogs.oracle.com/analyticscloud/learn-modern-data-visualization-with-oracle-analytics" target="_blank">Learn Modern Data Visualization with Oracle Analytics</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/preface.html#GUID-F92EB139-10CE-481F-BC11-E5C06F9D8FD5" target="_blank">Configuring Oracle Analytics Cloud</a></li><ul><li>Intended for administrators who use Oracle Analytics Cloud</li></ul><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/index.html" target="_blank">OAC public documentation</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acsom/get-started-administration.html#GUID-7E1301C3-FAB7-471B-8A68-8D153D3B229B" target="_blank">Administering Oracle Analytics Cloud</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acabi/get-started-configuration.html" target="_blank">Configuring Oracle Analytics Cloud</a></li><li>Click <a href="https://www.oracle.com/business-analytics/" target="_blank">here</a> for more A-Team Oracle Analytics (OAC) Blogs.</li><li><a href="https://docs.oracle.com/en/middleware/bi/analytics-server/security-oas/managing-security-oracle-analytics-server.pdf" target="_blank">Oracle Analytics Managing Security for Oracle Analytics Server, 5.9.0</a> (pdf)</li><li><a href="https://docs.oracle.com/en/middleware/bi/analytics-server/security-oas/index.html" target="_blank">Managing Security for Oracle Analytics Server</a> (5.9.0)</li><li><a href="https://www.schgroup.com/resource/blog-post/oracle-analytics-cloud-unwinding-user-security-in-data-visualization/" target="_blank">Oracle Analytics Cloud: Unwinding User Security in Data Visualization</a></li><li><a href="https://www.oracle.com/webfolder/technetwork/tutorials/obe/cloud/oac_bi/securing_content/securingcontentanalyticscloud.html" target="_blank">Securing Oracle Analytics Cloud Content</a></li><li><a href="https://www.oracle.com/business-analytics/data-visualization/library-overview.html" target="_blank">Oracle analytics library</a> (good)</li><li><a href="https://www.oracle.com/webfolder/technetwork/tutorials/obe/cloud/bics/storytelling/Insights.html#section1" target="_blank">Presenting Visualization using Insights and Stories in Visual Analyzer</a></li><li><a href="https://docs.oracle.com/en/cloud/paas/analytics-cloud/acoci/manage-service-access-and-security.html#GUID-3DB25824-4417-4981-9EEC-29C0C6FD3883" target="_blank">Administering Oracle Analytics Cloud on Oracle Cloud Infrastructure (Gen 2)</a></li></ol></div></div>Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com2tag:blogger.com,1999:blog-748094882401183761.post-81529349081982279742019-01-28T12:19:00.002-06:002021-06-06T17:29:39.326-05:00Kibana―Knowing the ELK Basics<div dir="ltr" style="text-align: left;" trbidi="on">
<meta name="viewport" content="width=device-width, initial-scale=1">
<div class="separator" style="clear: both; text-align: center;">
<br /></div>
<div style="text-align: center;"><iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/j8BwkozXdzo/0.jpg" frameborder="0" height="266" src="https://www.youtube.com/embed/j8BwkozXdzo?feature=player_embedded" width="320"></iframe></div>
<table cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjmke7VdYNqOf6MjyuQBzFMCNdinLDdQqSYTQKFmCnFpKh1f0VMStT2vRgm-q8Gv5oqiM1_c9z7WdhCR5BmFHI6ZjwTCgiIR8mczTBR2ejrzN9gYlTlZtJ773jykcAf-r-5GaI8F9pmc_m0/s1600/ELK.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="119" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjmke7VdYNqOf6MjyuQBzFMCNdinLDdQqSYTQKFmCnFpKh1f0VMStT2vRgm-q8Gv5oqiM1_c9z7WdhCR5BmFHI6ZjwTCgiIR8mczTBR2ejrzN9gYlTlZtJ773jykcAf-r-5GaI8F9pmc_m0/s1600/ELK.jpg" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 1. ELK Stack</b></td></tr>
</tbody></table>
<div class="separator" style="clear: both; text-align: center;">
<br /></div>
The most popular usage of <a href="https://en.wikipedia.org/wiki/Elasticsearch" target="_blank">Elasticsearch</a> today is Log Management. It is developed alongside a data-collection and log-parsing engine called <a href="https://www.elastic.co/products/logstash" target="_blank">Logstash</a>, and an analytics and visualization platform called <a href="https://en.wikipedia.org/wiki/Kibana">Kibana</a>. The three products are designed for use as an integrated solution, referred to as the "<b>Elastic Stack</b>" (formerly the "<b>ELK </b>stack"):<br />
<blockquote class="tr_bq">
<a href="https://www.elastic.co/products/logstash" target="_blank">Logstash</a> is the workhorse that collects the log files from Application Servers, parses them, formats them and sends them to Elastic Search. <a href="https://www.elastic.co/" target="_blank">Elastic Search</a> stores and indexes the data, which is presented by <a href="https://www.elastic.co/products/kibana" target="_blank">Kibana</a>. The end users access <a href="https://www.elastic.co/products/kibana" target="_blank">Kibana</a> Web Interface to view the data. </blockquote>
<br />
One of the great things about <a href="https://en.wikipedia.org/wiki/Elasticsearch" target="_blank">Elasticsearch</a> is its extensive JSON based REST API which allows you to integrate, manage and query the indexed data in countless different ways.<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/YsYUgZu9-Y4/0.jpg" frameborder="0" height="266" src="https://www.youtube.com/embed/YsYUgZu9-Y4?feature=player_embedded" width="320"></iframe></div>
<br />
<h3>
Elastic Search </h3>
<br />
<a href="https://www.elastic.co/" target="_blank">Elastic Search</a> is a robust search and analytics tool that stores data in a <u>document oriented data
store</u>. It has the following features:<br />
<ul style="text-align: left;">
<li>Is built on top of high performance open source search engine<b> <a href="https://lucene.apache.org/core/" target="_blank">Apache Lucene</a></b> (in Java)</li>
<ul>
<li>Started off as scalable Lucene</li>
<ul>
<li>Horizontally scalable search engine</li>
</ul>
<li>Often a faster solution than Hadoop/Spark/Flink/etc.</li>
</ul>
<li><b>Document oriented storage</b></li>
<ul>
<li>The <a href="https://en.wikipedia.org/wiki/Document-oriented_database" target="_blank">document oriented storage</a> differs sharply from traditional table oriented <a href="https://en.wikipedia.org/wiki/Relational_database_management_system" target="_blank">RDBMS</a> (Such as Oracle, MS SQL Server).</li>
<li>With document oriented data storage, data is <span style="font-weight: bold;">stored as structured <a href="https://en.wikipedia.org/wiki/JSON" target="_blank">JSON</a> </span><span style="font-weight: bold;">documents</span>.</li>
<li><u>Every field is indexed</u> by default. </li>
<ul>
<li>This is why the search speed is incredible.</li>
<li>Each <a href="https://qbox.io/blog/optimizing-elasticsearch-how-many-shards-per-index" target="_blank">shard</a> is an <a href="https://www.elastic.co/guide/en/elasticsearch/guide/current/inverted-index.html" target="_blank">inverted index</a> of documents.</li>
</ul>
</ul>
<li><b>Consumes data from Logstash </b></li>
<ul>
<li><b>Creates Indexes</b> for log files, typically a <u>date-based index</u></li>
</ul>
<li>Its <b>architecture </b>favors <b>distribution</b></li>
<ul>
<li>You can <u>scale </u>your Elastic Search infrastructure massively and seamlessly.</li>
</ul>
</ul>
<div>
<br /></div>
You can get the latest version of Elasticsearch from <a href="https://www.elastic.co/downloads/elasticsearch">elastic.co/downloads/elasticsearch</a>. Once you have an instance of ElasticSearch up and running you can talk to it using it's REST API residing at localhost port 9200. For example, you can run the following <a href="https://www.computerhope.com/unix/curl.htm" target="_blank">curl </a>command:<br />
<br />
<div>
<div>
<pre class="programlisting prettyprint lang-sh prettyprinted" style="background-color: #f0f0f0; border-radius: 0px 5px 5px 0px; border: none; box-sizing: border-box; color: #333333; display: inline-block; font-family: consolas, menlo, "dejavu sans mono", "bitstream vera sans mono", "lucida console"; line-height: 1.5em; max-width: 10000px; overflow-wrap: break-word; overflow: auto; padding: 8px 0px 8px 18px; width: auto;"><span style="font-size: x-small;"><span class="pln" style="box-sizing: border-box; color: black;">curl </span><span class="str" style="box-sizing: border-box; color: #008800;">'http://localhost:9200/?pretty'</span></span></pre>
</div>
<div>
<br /></div>
<div>
to get a response like this:<sup>[2]</sup></div>
<div>
<br />
<div class="pre_wrapper" style="background-color: #f0f0f0; border-left: 3px solid rgb(0, 169, 229); box-sizing: border-box; color: #444444; display: inline-flex; font-family: "open sans", "arial, helvetica, sans-serif"; margin: 0px 0px 15px; overflow-x: auto; position: relative; width: 750px;">
<pre class="programlisting prettyprint lang-js prettyprinted" style="border-radius: 0px 5px 5px 0px; border: none; box-sizing: border-box; color: #333333; display: inline-block; font-family: consolas, menlo, "dejavu sans mono", "bitstream vera sans mono", "lucida console"; line-height: 1.5em; max-width: 10000px; overflow-wrap: break-word; overflow: auto; padding: 8px 0px 8px 18px; width: auto;"><span style="font-size: x-small;"><span class="pun" style="box-sizing: border-box; color: #666600;">{</span><span class="pln" style="box-sizing: border-box; color: black;">
</span><span class="str" style="box-sizing: border-box; color: #008800;">"name"</span><span class="pln" style="box-sizing: border-box; color: black;"> </span><span class="pun" style="box-sizing: border-box; color: #666600;">:</span><span class="pln" style="box-sizing: border-box; color: black;"> </span><span class="str" style="box-sizing: border-box; color: #008800;">"Tom Foster"</span><span class="pun" style="box-sizing: border-box; color: #666600;">,</span><span class="pln" style="box-sizing: border-box; color: black;">
</span><span class="str" style="box-sizing: border-box; color: #008800;">"cluster_name"</span><span class="pln" style="box-sizing: border-box; color: black;"> </span><span class="pun" style="box-sizing: border-box; color: #666600;">:</span><span class="pln" style="box-sizing: border-box; color: black;"> </span><span class="str" style="box-sizing: border-box; color: #008800;">"elasticsearch"</span><span class="pun" style="box-sizing: border-box; color: #666600;">,</span><span class="pln" style="box-sizing: border-box; color: black;">
</span><span class="str" style="box-sizing: border-box; color: #008800;">"version"</span><span class="pln" style="box-sizing: border-box; color: black;"> </span><span class="pun" style="box-sizing: border-box; color: #666600;">:</span><span class="pln" style="box-sizing: border-box; color: black;"> </span><span class="pun" style="box-sizing: border-box; color: #666600;">{</span><span class="pln" style="box-sizing: border-box; color: black;">
</span><span class="str" style="box-sizing: border-box; color: #008800;">"number"</span><span class="pln" style="box-sizing: border-box; color: black;"> </span><span class="pun" style="box-sizing: border-box; color: #666600;">:</span><span class="pln" style="box-sizing: border-box; color: black;"> </span><span class="str" style="box-sizing: border-box; color: #008800;">"2.1.0"</span><span class="pun" style="box-sizing: border-box; color: #666600;">,</span><span class="pln" style="box-sizing: border-box; color: black;">
</span><span class="str" style="box-sizing: border-box; color: #008800;">"build_hash"</span><span class="pln" style="box-sizing: border-box; color: black;"> </span><span class="pun" style="box-sizing: border-box; color: #666600;">:</span><span class="pln" style="box-sizing: border-box; color: black;"> </span><span class="str" style="box-sizing: border-box; color: #008800;">"72cd1f1a3eee09505e036106146dc1949dc5dc87"</span><span class="pun" style="box-sizing: border-box; color: #666600;">,</span><span class="pln" style="box-sizing: border-box; color: black;">
</span><span class="str" style="box-sizing: border-box; color: #008800;">"build_timestamp"</span><span class="pln" style="box-sizing: border-box; color: black;"> </span><span class="pun" style="box-sizing: border-box; color: #666600;">:</span><span class="pln" style="box-sizing: border-box; color: black;"> </span><span class="str" style="box-sizing: border-box; color: #008800;">"2015-11-18T22:40:03Z"</span><span class="pun" style="box-sizing: border-box; color: #666600;">,</span><span class="pln" style="box-sizing: border-box; color: black;">
</span><span class="str" style="box-sizing: border-box; color: #008800;">"build_snapshot"</span><span class="pln" style="box-sizing: border-box; color: black;"> </span><span class="pun" style="box-sizing: border-box; color: #666600;">:</span><span class="pln" style="box-sizing: border-box; color: black;"> </span><span class="kwd" style="box-sizing: border-box; color: #000088;">false</span><span class="pun" style="box-sizing: border-box; color: #666600;">,</span><span class="pln" style="box-sizing: border-box; color: black;">
</span><span class="str" style="box-sizing: border-box; color: #008800;">"lucene_version"</span><span class="pln" style="box-sizing: border-box; color: black;"> </span><span class="pun" style="box-sizing: border-box; color: #666600;">:</span><span class="pln" style="box-sizing: border-box; color: black;"> </span><span class="str" style="box-sizing: border-box; color: #008800;">"5.3.1"</span><span class="pln" style="box-sizing: border-box; color: black;">
</span><span class="pun" style="box-sizing: border-box; color: #666600;">},</span><span class="pln" style="box-sizing: border-box; color: black;">
</span><span class="str" style="box-sizing: border-box; color: #008800;">"tagline"</span><span class="pln" style="box-sizing: border-box; color: black;"> </span><span class="pun" style="box-sizing: border-box; color: #666600;">:</span><span class="pln" style="box-sizing: border-box; color: black;"> </span><span class="str" style="box-sizing: border-box; color: #008800;">"You Know, for Search"</span><span class="pln" style="box-sizing: border-box; color: black;">
</span><span class="pun" style="box-sizing: border-box; color: #666600;">}</span></span></pre>
</div>
</div>
<div>
<br /></div>
<ul style="text-align: left;"><ul>
</ul>
</ul>
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/gUJvP2OZENk/0.jpg" frameborder="0" height="266" src="https://www.youtube.com/embed/gUJvP2OZENk?feature=player_embedded" width="320"></iframe></div>
<div style="text-align: center;">
<b><span style="font-size: x-small;">Video 2. Logstash Overview</span></b></div>
<br />
<h3>
Logstash</h3>
<div>
<br /></div>
<div>
<a href="https://www.elastic.co/products/logstash" target="_blank">Logstash</a>, another open source tool does the heavy lifting of consuming the logs from various systems
and sends them to <a href="https://en.wikipedia.org/wiki/Elasticsearch" target="_blank">Elastic Search</a>. It has the following features:</div>
<ul style="text-align: left;">
<li>Is a tool for collecting & monitoring logs from remote machines</li>
<ul>
<li><span style="font-weight: bold;">Data pushed and stored</span> in <a href="https://en.wikipedia.org/wiki/Elasticsearch" target="_blank">Elastic Search</a></li>
<ul>
</ul>
</ul>
<li>Is a data pipeline for <a href="https://en.wikipedia.org/wiki/Elasticsearch" target="_blank">Elasticsearch</a></li>
<ul>
<li><b>Parses, transforms, and filters</b> data as it passes through</li>
<ul>
<li>Can <b>derive structure</b> from unstructured data</li>
<li>Can <b>anonymize personal</b> data or exclude it entirely</li>
<li>Can do <b>geo-location lookups</b></li>
</ul>
<li>Guarantees at-least-once delivery</li>
<li>Absorbs throughput from load spikes</li>
<li>Can scale across many nodes</li>
</ul>
</ul>
<div>
<br /></div>
<div>
<div class="separator" style="clear: both; text-align: center;">
<iframe allowfullscreen="" class="YOUTUBE-iframe-video" data-thumbnail-src="https://i.ytimg.com/vi/gQ1c1uILyKI/0.jpg" frameborder="0" height="266" src="https://www.youtube.com/embed/gQ1c1uILyKI?feature=player_embedded" width="320"></iframe></div>
<br /></div>
<h3>
Kibana</h3>
<div>
<br /></div>
<div>
<a href="https://en.wikipedia.org/wiki/Kibana">Kibana</a> is an open source data exploration & visualization platform that is the presentation layer in the ELK stack. It consumes
data from Elastic Search Indexes. A user accesses Kibana interface via a web browser.</div>
<ul style="text-align: left;">
<li><b>Used for</b> </li>
<ul>
<li>Log and time series analytics, application monitoring & operational intelligence</li>
</ul>
<li><span style="font-weight: bold;">Make queries</span> in <span style="color: red; font-weight: bold;">Elastic Search</span></li>
<ul>
<li>Enables the searching & interaction with data in <a href="https://en.wikipedia.org/wiki/Elasticsearch" target="_blank">Elastic Search</a></li>
<li>Allows performing advanced analytics & creation of reports</li>
</ul>
<li><b>Provide Real-time Dashboard</b></li>
<ul>
<li>Enables creation & sharing of dynamic dashboards that get updated in realtime</li>
</ul>
</ul>
<div>
<br /></div>
The default settings configure Kibana to run on localhost:5601. To change the host or port number, or connect to Elasticsearch running on a different machine, you'll need to update your <a href="https://github.com/elastic/kibana/blob/master/config/kibana.yml" target="_blank">kibana.yml</a> file. For more information, read:</div>
<div>
<ul style="text-align: left;">
<li><a href="https://www.elastic.co/guide/en/kibana/current/settings.html">Configuring Kibana</a></li>
<li><a href="https://www.elastic.co/guide/en/kibana/4.0/setup.html">Getting Kibana Up and Running</a></li>
</ul>
<div>
<br /></div>
<ul style="text-align: left;"><ul><ul><ul>
</ul>
</ul>
</ul>
</ul>
<h3>
References</h3>
<ol style="text-align: left;">
<li><a href="http://www.lucenetutorial.com/basic-concepts.html" target="_blank">Basic Concepts</a> (Apache Lucene)</li>
<li><a href="https://www.elastic.co/guide/en/elasticsearch/guide/current/running-elasticsearch.html" target="_blank">Installing and Running Elasticsearch</a></li>
<li><a href="http://karunsubramanian.com/wp-content/uploads/2017/02/15minuteintroductiontoELK1.pdf" target="_blank">15 Minutes Introduction to ELK (Elastic Search,LogStash,Kibana)</a></li>
<li><a href="https://www.elastic.co/guide/en/kibana/current/settings.html" target="_blank">Configuring Kibana</a></li>
<li><a href="https://www.elastic.co/guide/en/kibana/4.0/setup.html" target="_blank">Getting Kibana Up and Running</a></li>
<li><a href="https://www.elastic.co/guide/en/logstash/current/filter-plugins.html" target="_blank">Filter Plugins</a> (Logstach)</li>
<li><a href="https://www.youtube.com/watch?v=YsYUgZu9-Y4" target="_blank">Elasticsearch Architecture</a> (youtube)</li>
</ol>
</div>
</div>
Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com1tag:blogger.com,1999:blog-748094882401183761.post-30052147504083016042019-01-25T11:19:00.005-06:002021-12-16T11:38:25.468-06:00OCI―Knowing Gateway Basics<div dir="ltr" style="text-align: left;" trbidi="on">
An <a href="https://docs.cloud.oracle.com/iaas/Content/GSG/Concepts/concepts.htm" target="_blank">Oracle Cloud Infrastructure</a> (<b>OCI</b>) <a href="https://cloud.oracle.com/iaas/whitepapers/vcn-deployment-guide.pdf">Virtual Cloud Network</a> (<b>VCN</b>) is a virtual version of a traditional network—including subnets, route tables, and gateways—on which your <a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-compute-service-basics.html" target="_blank">instances</a> run.<br />
<br />
<div class="separator" style="clear: both; text-align: center;"><iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen="" frameborder="0" height="315" src="https://www.youtube.com/embed/lj1pDBhVOxk" title="YouTube video player" width="560"></iframe></div>
<div style="text-align: center;">
<span><b>Video 1. </b>OCI Level 100 - Connectivity (Demo starts at 20:00; YouTube <a href="https://www.youtube.com/watch?v=lj1pDBhVOxk" target="_blank">link</a>)</span><br />
<div>
<b><span style="font-size: x-small;"><br /></span></b></div>
</div>
<div style="text-align: center;">
<br /></div><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgVD35RppQywrl8CoArLkB_gtJtrqPSxEKUpmAmoy-zjXCWsbEwGle5z96zD93SjacZwOzSPKMskzm2sBCpfn2TFFjvxz8iMH5nGnHEa7IoR94xffHSopkp7m1KWYorKgsKI87HgvLU08K_/s1784/OAC_Architecture_Diagram.jpg" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="991" data-original-width="1784" height="312" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgVD35RppQywrl8CoArLkB_gtJtrqPSxEKUpmAmoy-zjXCWsbEwGle5z96zD93SjacZwOzSPKMskzm2sBCpfn2TFFjvxz8iMH5nGnHEa7IoR94xffHSopkp7m1KWYorKgsKI87HgvLU08K_/w640-h356/OAC_Architecture_Diagram.jpg" width="560" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Figure 1. </b>Sample OAC Architecture Diagram (Source: [3])</div><br />
There are different kinds of gateways supported in OCI for different purposes as shown in Table 1. Before we start, read this companion article first:<br />
<blockquote class="tr_bq">
<a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-virtual-cloud-network-basics.html" target="_blank">OCI―Knowing Virtual Cloud Network Basics</a></blockquote>
<br />
<br />
<table border="1" cellpadding="2" cellspacing="2" style="width: 100%px;">
<tbody>
<tr>
<td bgcolor="#ccffff" valign="top"><b>Gateway</b><b><sup><span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">1</span></sup></b></td>
<td align="center" bgcolor="#ccffff" valign="top"><b>Usage</b><b><br />
</b></td>
</tr>
<tr>
<td bgcolor="#ffffcc" valign="top">Internet Gateway<br />
(IGW)</td>
<td valign="top"><span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;"><span color="rgb(102 , 102 , 102)" style="font-weight: bold;">Public</span>
<span color="rgb(102 , 102 , 102)"><span style="color: red;">VCN</span> <-----> Internet
Gateway (</span><span color="rgb(102 , 102 , 102)" style="font-weight: bold;">Public</span> <span color="rgb(102 , 102 , 102)">IP address)
<-------> <span style="color: red;">Internet</span></span></span>
</td>
</tr>
<tr>
<td bgcolor="#ffffcc" valign="top">Dynamic Routing Gateway (DRG)<b><br />
</b></td>
<td valign="top"><span style="color: red; font-family: "courier new" , "courier" , monospace; font-size: x-small;">On-premises network</span><span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">
<----DRG---> </span><span style="color: red; font-family: "courier new" , "courier" , monospace; font-size: x-small;"><span color="rgb(102 , 102 , 102)" style="font-weight: bold;">Private</span>
<span color="rgb(102 , 102 , 102)"></span>VCN</span><br />
<div>
<span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;"><span color="rgb(102 , 102 , 102)" style="font-weight: bold;">Private</span>
<span color="rgb(102 , 102 , 102)"></span>VCN
(<span style="color: red;">region A</span>)
<---DRG---> <span color="rgb(102 , 102 , 102)" style="font-weight: bold;">Private</span>
<span color="rgb(102 , 102 , 102)"></span>VCN
(<span style="color: red;">region B</span>)</span></div>
</td>
</tr>
<tr>
<td bgcolor="#ffffcc" valign="top">NAT Gateway<b><br />
</b></td>
<td valign="top"><span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;"><span color="rgb(102 , 102 , 102)" style="font-weight: bold;">Private</span>
<span color="rgb(102 , 102 , 102)"><span style="color: red;">VCN</span> -----> NAT Gateway (</span><span color="rgb(102 , 102 , 102)" style="font-weight: bold;">Public</span> <span color="rgb(102 , 102 , 102)">IP address) <-------> <span style="color: red;">Internet</span><br />
</span>
</span>
<br />
<div style="-en-clipboard: false;">
<span color="rgb(255 , 0 , 0)" style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">VCN
<span style="color: black;">---OK---> </span>Internet</span></div>
<span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">
<span color="rgb(255 , 0 , 0)">VCN <span style="color: black;"><---NO---</span> Internet</span></span><br />
<span color="rgb(102 , 102 , 102)" style="font-family: "helvetica neue"; font-size: 12pt;"></span>
</td>
</tr>
<tr>
<td bgcolor="#ffffcc" valign="top">Service Gateway</td>
<td valign="top"><span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;"><span color="rgb(102 , 102 , 102)" style="font-weight: bold;">Private</span>
<span color="rgb(102 , 102 , 102)"><span style="color: red;">VCN </span></span><span color="rgb(102 , 102 , 102)"><span style="color: red;"><span color="rgb(102 , 102 , 102)"><-----><span style="color: red;"> <span style="color: black;">Service
Gateway </span></span></span></span></span></span><span color="rgb(102 , 102 , 102)"><span style="color: red;"><span color="rgb(102 , 102 , 102)"><span style="color: red;"><span style="color: black;"><span color="rgb(102 , 102 , 102)"><span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;"><------->
<b>Public</b> <span style="color: red;">OCI
Service</span> (e.g. Object Storage)<br />
<br />
<span style="color: black;">No need for <b>Public
IP address </b>on VCN or access to <b>Internet</b></span></span><br />
</span></span></span></span></span></span></td>
</tr>
<tr>
<td bgcolor="#ffffcc" valign="top">Local Peering Gateway<sup><span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">2</span></sup></td>
<td valign="top"><span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;"><span color="rgb(102 , 102 , 102)" style="font-weight: bold;">Private</span>
VCN (<span style="color: red;">region
A</span>) <span color="rgb(102 , 102 , 102)"><span style="color: red;"><span color="rgb(102 , 102 , 102)"><----->
</span></span></span><span color="rgb(102 , 102 , 102)" style="font-weight: bold;">Private</span> </span><span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;"><span color="rgb(102 , 102 , 102)"></span>VCN
(<span style="color: red;">region A</span>)<br />
<br />
With <b>Private IP address </b>and <b>Private network
traffic</b></span><br />
<span color="rgb(102 , 102 , 102)" style="font-family: "helvetica neue"; font-size: 12pt;"><span style="color: red;"></span></span></td>
</tr>
</tbody>
</table>
<div style="text-align: center;">
<b><span style="font-size: x-small;">Table 1. Gateways supported in OCI</span></b></div>
<b><br /></b>
<b>Notes:</b><br />
<ol style="text-align: left;">
<li>Traffic between a given VCN and gateway is controlled by
the VCN's <span style="background-color: yellow;">route table</span> and <span style="background-color: yellow;">security
lists</span>.
</li>
<ul>
<li>After creating an IGW or attaching a DRG, you must add a route for the IGW/DRG in the VCN's route table to enable traffic flow. You can watch <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">video</span><span style="font-family: "times new roman";"> above for more information.</span></li>
</ul>
<li>Without peering, a given VCN would need an internet gateway
and public IP addresses for the instances that need to
communicate with another VCN.<br />
</li>
</ol>
<div>
<br /></div>
<div>
<h3>
Public IP vs Private IP</h3>
<br />
Instances use IP addresses for communication. Each <a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-compute-service-basics.html" target="_blank">instance</a> has at least one <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingIPaddresses.htm?Highlight=private%20IPs" target="_blank">private IP address</a> and at least one <u>optional</u> <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingpublicIPs.htm" target="_blank">public IP address</a>:<br />
<div>
<ul>
<li><b>Private IP address</b></li>
<ul>
<li>Enables the instance to communicate with other instances inside the VCN, or with hosts in your on-premises network (via an IPSec VPN or Oracle Cloud Infrastructure FastConnect). </li>
<li>Each instance receives a primary private IP object during launch. </li>
<li>The private IP object is terminated when the instance is terminated.</li>
</ul>
<li><b>Public IP address</b> (<span style="color: red;">optional</span>)</li>
<ul>
<li>Enables the instance to communicate with hosts on the internet.</li>
<li>A private IP can have a <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingpublicIPs.htm">public IP</a> assigned to it at your discretion.</li>
</ul>
</ul>
</div>
</div>
<br />
<h3>
Public Subnet vs Private Subnet</h3>
<br />
<a href="https://cloud.oracle.com/iaas/whitepapers/vcn-deployment-guide.pdf">Virtual Cloud Network</a> (VCN) is a virtual cloud<b> </b>network that you set up in Oracle data centers and it's <u>private</u>.<br />
<div>
<br /></div>
<div>
A subnet is a subdivision of a VCN and it can be designated as either <b>Public </b>or <b>Private</b>. <b> </b>You choose this during subnet creation, and you can't change it later.<br />
<div>
<ul style="text-align: left;">
<li><b>Public Subnet </b>(default)</li>
<ul>
<li>Instances in that subnet are allowed to have public IP addresses</li>
</ul>
<li><b>Private Subnet</b> </li>
<ul>
<li>Instances in the subnet have no internet access</li>
<li>Instances in the subnet are prohibited from having public IP addresses</li>
</ul>
</ul>
<div>
<div style="text-align: left;">
<h3>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td class="tr-caption" style="font-size: 12.8px;"></td></tr>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhgx6KcuWrNMAKfDzwm_ouEK733WM7eAGIJXEgZL0QvQRLXBfvP_dM7An4ZCE2DfYhLjd05-f78iSlSV-LbTXH0XjbPyVZf8StAKpLXfCdjTlMnPW-84bfwAvZ_mlp5u1FYwPEpJsSKEAl5/s1600/DRG_IGW.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="350" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhgx6KcuWrNMAKfDzwm_ouEK733WM7eAGIJXEgZL0QvQRLXBfvP_dM7An4ZCE2DfYhLjd05-f78iSlSV-LbTXH0XjbPyVZf8StAKpLXfCdjTlMnPW-84bfwAvZ_mlp5u1FYwPEpJsSKEAl5/s1600/DRG_IGW.jpg" /></a></td></tr>
<tr><td class="tr-caption"><b>Figure 2. </b>Internet Gateway (IGW) and Dynamic Routing Gateway (DRG)<br />
<div style="font-size: 12.8px;">
<b><br /></b>
<br />
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjUvAVbkCON-zrjWE40LVbYHrJSgSqDRI-EBN7YtS6YY9k_Dhn97kzS45YL9XmjMz_59WYOCvGpd6dQhmErzI5p9Od-GPPNCBK1I0ozO_r_PY7rD2C8M_HdF9lNXk3WlgH_KZaRbjcclral/s1600/IPsec_VPN.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="293" data-original-width="720" height="228" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjUvAVbkCON-zrjWE40LVbYHrJSgSqDRI-EBN7YtS6YY9k_Dhn97kzS45YL9XmjMz_59WYOCvGpd6dQhmErzI5p9Od-GPPNCBK1I0ozO_r_PY7rD2C8M_HdF9lNXk3WlgH_KZaRbjcclral/s640/IPsec_VPN.jpg" width="560" /></a></td></tr>
<tr><td class="tr-caption"><b>Figure 3. </b><a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingIPsec.htm?Highlight=IPSec%20VPN" target="_blank">IPSec VPN</a> Overview<br />
<div style="font-size: 12.8px;">
<b><br /></b></div>
</td></tr>
</tbody></table>
</div>
</td></tr>
</tbody></table>
</h3>
<h3>
<b>Gateways</b></h3>
</div>
<div>
<b><u><br /></u></b></div>
<div>
Gateways are virtual routers which provide controlled entry points for traffic. There are different kinds of gateways supported in OCI and some of them are listed below: </div>
<div>
<ul style="text-align: left;">
<li><b>Internet Gateway </b>(<a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingIGs.htm?Highlight=Internet%20Gateway" target="_blank">IGW</a>)</li>
<ul>
<li>Provides a path for network traffic between your VCN and the Internet</li>
</ul>
<li><b>Dynamic Routing Gateway</b> (<a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingDRGs.htm?Highlight=DRG" target="_blank">DRG</a>)</li>
<ul>
<li>Provides a path for private traffic (that is, traffic that uses private IPv4 addresses) between your VCN and networks outside the VCN's region.</li>
<ul>
<li>Provides a single point of entry for remote network paths coming into a VCN</li>
</ul>
<li>Is a standalone object</li>
<ul>
<li>To use it, you must <u>attach it to a VCN</u></li>
<li>A VCN can be attached to only one DRG at a time, and a DRG can be attached to only one VCN at a time</li>
</ul>
<li>You can use it to </li>
<ul>
<li>Connect a VCN to your on-premises network through</li>
<ul>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingIPsec.htm?Highlight=IPSec%20VPN" target="_blank">IPSec VPN</a> (<a href="https://docs.oracle.com/en/solutions/connect-onprem-vpn/index.html#GUID-D96D1542-CACC-4294-A870-E0BD4A6730D2" target="_blank">doc</a>) or <a href="https://docs.cloud.oracle.com/iaas/Content/Search.htm?q=FastConnect&f=" target="_blank">FastConnect</a> (see Figure 2&3)</li>
</ul>
<li>Peer your VCN with a VCN in another region</li>
</ul>
</ul>
<li><b>NAT Gateway</b></li>
<ul>
<li>Gives instances in a private subnet access to the internet</li>
<ul>
<li>Instances in a private subnet don't have public IP addresses. With the <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/NATgateway.htm?Highlight=nat%20gateway" target="_blank">NAT gateway</a>, they <u>can initiate connections to the internet and receive responses</u>, but <u>not receive inbound connections initiated from the internet</u>.</li>
</ul>
<li>Are highly available and support TCP, UDP, and ICMP ping traffic.</li>
<li>Is automatically always attached to only one VCN of your choice.</li>
</ul>
<li><b><a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/servicegateway.htm?Highlight=Service%20Gateway" target="_blank">Service Gateway</a></b></li>
<ul>
<li>Used for subnets that need <u>private access</u> to a <u>public OCI service</u> such as <a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-object-storage-basics.html" target="_blank">Object Storage</a>.</li>
<ul>
<li>For example, DB Systems in a private subnet in your VCN can back up data to Object Storage without needing public IP addresses or access to the internet.</li>
</ul>
</ul>
<li><b>Local Peering Gateway </b>(<a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/localVCNpeering.htm" target="_blank">LPG</a>)</li>
<ul>
<li>Used for subnets that need <u>private access</u> to a peered VCN in the <u>same region</u>.</li>
<li>Allows VCNs to communicate using private IP addresses, without the traffic traversing the internet or routing through your on-premises network.</li>
<li>A given VCN must have a separate LPG for each peering it establishes.</li>
</ul>
</ul>
<div>
<br /></div>
<div style="text-align: left;">
<h3>
References</h3>
</div>
</div>
</div>
</div>
</div>
<div>
<ol>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Network/Concepts/overview.htm" target="_blank">Networking</a> (OCI)</li>
<li><a href="https://www.youtube.com/watch?v=lj1pDBhVOxk" target="_blank">OCI Level 100 - Connectivity</a><span id="goog_263194315"></span><a href="https://draft.blogger.com/"></a><span id="goog_263194316"></span> (Youtube)</li><li>"<a href="https://learn.oracle.com/ols/course/best-practices-for-implementing-analytics-cloud/35573/78341" target="_blank">Best Practices for implementing Analytics Cloud</a>" from Oracle University</li></ol></div>
<div>
<br /></div>
<div>
<br /></div>
</div>
Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com1tag:blogger.com,1999:blog-748094882401183761.post-14092363309207053562019-01-21T11:54:00.001-06:002021-11-24T11:01:14.384-06:00OCI―Knowing Database Service Basics<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;"><iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen="" frameborder="0" height="315" src="https://www.youtube.com/embed/dmk4GcLlobo" title="YouTube video player" width="560"></iframe></div>
<div class="separator" style="clear: both; text-align: center;">
<span><b>Video 1. </b>OCI Level 100 - Database (Demo starts at 30:20; YouTube <a href="https://www.youtube.com/watch?v=dmk4GcLlobo" target="_blank">link</a>)</span></div>
<div class="separator" style="clear: both; text-align: center;">
<br /></div>
The <a href="https://docs.cloud.oracle.com/iaas/Content/GSG/Concepts/concepts.htm">Oracle Cloud Infrastructure</a> (<b>OCI</b>) Database service (<b>DS</b>) offers autonomous and user-managed Oracle Database solutions:<br />
<ul style="text-align: left;">
<li><b>Fully-managed</b> </li>
<ul>
<li>Autonomous databases are preconfigured, fully-managed environments that are suitable for either <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">transaction processing</span> or for <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">data warehouse</span> workloads. </li>
<li>See <a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-autonomous-database-basics.html" target="_blank">OCI―Knowing Autonomous Database Basics</a> for more information</li>
</ul>
<li><b>User-managed</b></li>
<ul>
<li>User-managed solutions are bare metal (<b>BM</b>), virtual machine (<b>VM</b>), and <b>Exadata</b> <b>DB </b>systems that you can customize with the resources and settings that meet your needs.</li>
</ul>
</ul>
You can quickly provision a user-managed DB system or autonomous database. You have full access to the features and operations available with the database, but <u>Oracle owns and manages the infrastructure</u>:<br />
<br />
In this article, we will cover mainly on Oracle provided user-managed solutions and use <b>DS </b>to mean either DB System or Database Service.<br />
<br />
<br />
<table align="center" border="1" cellpadding="2" cellspacing="2" style="width: 520px;"><tbody>
<tr><td valign="top"><br /></td><td valign="top"><b>Virtual Machine (VM)</b></td><td valign="top"><b>Bare Metal (BM)</b></td><td valign="top"><b>Exadata</b></td></tr>
<tr><td valign="top"><b>Scaling</b></td><td valign="top">Storage (number of<br />
CPU cores on VM DB<br />
cannot be changed)</td><td valign="top">CPU (amount of available<br />
storage cannot be<br />
changed)</td><td valign="top">CPU can be scaled within<br />
a <span face=""arial" , sans-serif" style="background-color: white; color: #222222; font-size: x-small;">¼</span>, <span face=""arial" , sans-serif" style="background-color: white; color: #222222; font-size: x-small;">½</span> and Full rack.<br />
Storage cannot be scaled</td></tr>
<tr><td valign="top"><b>Multiple<br />Homes/Databases</b></td><td valign="top">No, single DB and Home only</td><td valign="top">Yes (one edition, but<br />
different versions<br />
possible)</td><td valign="top">Yes</td></tr>
<tr><td valign="top"><b>Storage</b></td><td valign="top">Block Storage</td><td valign="top">Local NVMe disks</td><td valign="top">Local spinning disks and NVMe flash cards.</td></tr>
<tr><td valign="top"><a href="https://www.oracle.com/database/technologies/rac.html" target="_blank"><b>Real Application Clusters</b></a> (<b>RAC</b>)</td><td valign="top">Available (2-node)</td><td valign="top">Not Available</td><td valign="top">Available</td></tr>
<tr><td valign="top"><a href="https://docs.oracle.com/cd/B19306_01/server.102/b14239/concepts.htm#g1049956" target="_blank"><b>Data Guard</b></a></td><td valign="top">Not Available</td><td valign="top">Available<sup>*</sup></td><td valign="top">Available<sup>*</sup></td></tr>
</tbody></table>
<br />
*: You can manually configure <a href="https://docs.oracle.com/cd/B19306_01/server.102/b14239/concepts.htm#g1049956" target="_blank">Data Guard</a> on Exadata DB systems using native Oracle Database Utilities and commands. <a href="https://docs.cloud.oracle.com/iaas/Content/Database/References/dbacli.htm?Highlight=dbcli" target="_blank">dbcli</a> is not available on Exadata Data systems.<br />
<br />
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh6UkQAQqxejsBM1YLQdRniJ-F-aJ_cLfEzl5Lr81axSkMdeGIjtHc2BzIxbvMRn2f8Jzr2qkXS-ywXzBLcy0ok6Z3ViykINx-lk-Wtt4FzQ1o0fOZD4Pm8CuaGvaxH5x54yuUwiZv-lb6c/s1600/Exadata_max_availabilityArchitecture.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="440" data-original-width="1024" height="240" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh6UkQAQqxejsBM1YLQdRniJ-F-aJ_cLfEzl5Lr81axSkMdeGIjtHc2BzIxbvMRn2f8Jzr2qkXS-ywXzBLcy0ok6Z3ViykINx-lk-Wtt4FzQ1o0fOZD4Pm8CuaGvaxH5x54yuUwiZv-lb6c/s640/Exadata_max_availabilityArchitecture.jpg" width="560" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><div style="text-align: center;">
<b>Figure 1. Exadata Database System with the Maximum Availability Architecture:</b></div>
</td></tr>
</tbody></table>
<br />
<h3>
DS Features</h3>
<br />
OCI Database Service has the following features:<br />
<ul style="text-align: left;">
<li><b>Comprehensive offerings</b> to cover all enterprise database needs</li>
<ul>
<li>3 Shape Types:</li>
<ul>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Database/Concepts/exaoverview.htm" target="_blank"><b>Exadata</b></a>, <b>Bare Metal</b>, <b>Virtual Machine</b> </li>
<li>Each type with different shapes </li>
</ul>
<li>Supports various <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">Oracle database software editions</span>, <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">license types</span>, <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">database versions</span>, and <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">database workloads</span> (<a href="https://docs.cloud.oracle.com/iaas/Content/Database/References/sizingtemplates.htm?Highlight=oltp" target="_blank">OLTP </a>vs <a href="https://docs.cloud.oracle.com/iaas/Content/Database/References/sizingtemplates.htm?Highlight=DSS" target="_blank">DSS</a>)</li>
</ul>
<li><b>Lifecycle Automation</b></li>
<ul>
<li>Provisioning, Patching, Backup & Restore</li>
</ul>
<li><b>High Availability </b></li>
<ul>
<li><a href="https://www.oracle.com/database/technologies/rac.html" target="_blank">RAC</a> & <a href="https://docs.oracle.com/cd/B19306_01/server.102/b14239/concepts.htm#g1049956" target="_blank">Data Guard</a></li>
</ul>
<li><b>Scalability</b></li>
<ul>
<li>Dynamic CPU and Storage scaling</li>
</ul>
<li><b>Security</b></li>
<ul>
<li>Infrastructure (IAM, Security Lists, Audit logs)</li>
<li>Database (<a href="https://en.wikipedia.org/wiki/Transparent_Data_Encryption" target="_blank">TDE</a>, RMAN backup/Block volume encryption)</li>
</ul>
<li><b>OCI Platform integration</b></li>
<ul>
<li>Tagging, Limits and Usage Integration</li>
</ul>
<li><b>License Type</b></li>
<ul>
<li><b>License Included </b>with OCI provisioning</li>
<li><b>Bring Your Own License</b> (<a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/launchingDB.htm?Highlight=BYOL" target="_blank">BYOL</a>)</li>
</ul>
</ul>
With Exadata DS, all types of failures are protected against, including disk, server, network and data.<br />
<br />
<h3>
Managing DS</h3>
<br />
You can use the console to perform the following tasks:<br />
<ul style="color: black; font-family: "times new roman"; font-size: medium; font-style: normal; letter-spacing: normal; text-align: left; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px;">
<li style="font-weight: 400;"><b>Launch DS</b> </li>
<ul style="font-weight: 400;">
<li>Which also create a database system</li>
</ul>
<li style="font-weight: 400;"><b>Start, stop or reboot DS</b></li>
<ul style="font-weight: 400;">
<li>Billing continues in stop state for BM DB Systems because its attached local NVMe, but not for VM </li>
</ul>
<li style="font-weight: 400;"><b>Scale CPU cores</b> (except for VM)</li>
<li style="font-weight: 400;"><b>Scale up storage</b> (VM only)</li>
<li style="font-weight: 400;"><b>Terminate</b></li>
<ul>
<li>When you terminate a DB system or a database, all of its resources are deleted, along with any <u>automatic backups</u>. </li>
<li><u>Full backups</u> remain in Object Storage as <b>standalone backups</b>. </li>
<ul style="font-weight: 400;">
<li>You can use a standalone backup to create a new database.</li>
</ul>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="font-weight: 400; margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhR7LwVwqVYStggEu6RGOYSpY6uvSmgKCznn9G7SBCUtlkdsr2_BDw41pyfgbEZFJFiavo8h1Rurw0xjddJbhIgOMJrCVeyE0gm548pmFIR5dmXNk1y8614rM9ceA_UWu3w_8Jusr8oglmt/s1600/DS_patching.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="331" data-original-width="1600" height="116" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhR7LwVwqVYStggEu6RGOYSpY6uvSmgKCznn9G7SBCUtlkdsr2_BDw41pyfgbEZFJFiavo8h1Rurw0xjddJbhIgOMJrCVeyE0gm548pmFIR5dmXNk1y8614rM9ceA_UWu3w_8Jusr8oglmt/s640/DS_patching.jpg" width="560" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 2. Db System patch (upper) vs Database patch (lower)</b></td></tr>
</tbody></table>
</ul>
</ul>
<h3>
Patching DS</h3>
<div>
<br />
Because patching a system <u>requires a reboot</u>, plan to run the operations at a time when they will have minimal impact on users. To avoid system interruption, consider implementing a high availability strategy such as <a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/usingDG.htm" target="_blank">Oracle Data Guard</a>.</div>
<div>
<br /></div>
Using the Console, <a href="https://docs.cloud.oracle.com/iaas/api/#/" target="_blank">API</a>, or the database CLI (<a href="https://docs.cloud.oracle.com/iaas/Content/Database/References/dbacli.htm?Highlight=dbcli" target="_blank">dbcli</a>), you can perform below tasks:<br />
<ul style="text-align: left;">
<li><b>Managed/On-Demand Patching</b></li>
<ul>
<li>Automated applicable patch discovery and pre-flight checks/tests</li>
</ul>
<li><b>On Demand Patching</b></li>
<ul>
<li>N-1 patching (previous patch is available if it hasn't been applied), pre-check and patching at the click of a button</li>
</ul>
<li><b>Availability during Patching </b></li>
<ul>
<li>For Exadata and RAC shapes, patches are rolling.</li>
<li>For single node systems, Active Data Guard can be leveraged by the patch service if it is configured</li>
</ul>
<li><b>2-Step Process</b></li>
<ul>
<li>Patching is a 2 step process. To perform a patch operation on a</li>
<ol>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/patchingDB.htm#" target="_blank">DB System</a></li>
<li>D<a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/patchingDB.htm#" target="_blank">atabase</a></li>
</ol>
</ul>
<li><b>Identity and Access Controls</b></li>
<ul>
<li>Controls who can list patches, apply them, etc</li>
</ul>
</ul>
<br />
<h3>
Backup / Restore</h3>
<br />
If you plan to back up your DB system to <a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-object-storage-basics.html" target="_blank">Object Storage</a>, you can use a <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/servicegateway.htm?Highlight=service%20gateway" target="_blank">service gateway</a> with a private subnet or an <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingIGs.htm?Highlight=internet%20gateway" target="_blank">internet gateway</a> with a public subnet. To recover a database from Object Storage, you can use the Console, <a href="https://docs.cloud.oracle.com/api/#/en/database/latest" target="_blank">API</a>, or by using <a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/backingupOSrman.htm?Highlight=RMAN" target="_blank">RMAN</a>.<sup>[2]</sup><br />
<br />
For backup and restore, OCI Database Service supports:<br />
<ul style="text-align: left;">
<li><b>Managed Backup </b></li>
<ul>
<li>Exadata backup process requires creating a backup config file. See <a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/exabackingup.htm" target="_blank">Backing Up an Exadata Database</a> for more information.</li>
<li>For BM/VM backups, see "Backup Destinations" below.</li>
</ul>
<li><b>Private Networking</b></li>
<ul>
<li>The resources in the DS can be in a private subnet and use only private IP addresses.</li>
<li>Even with an <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingIGs.htm?Highlight=internet%20gateway" target="_blank">internet gateway</a>, network traffic between the DS and <a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-object-storage-basics.html" target="_blank">Object Storage</a> does not leave the cloud and never reaches the public internet.</li>
</ul>
<li><b>Backup Destinations</b></li>
<ul>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/backingupOS.htm" target="_blank">Object Storage</a> (recommended) or <a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/backingupFRA.htm" target="_blank">Local Storage</a></li>
<ul>
<li>For Exadata backups, read <a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/exabackingup.htm" target="_blank">Backing Up an Exadata Database</a> for information</li>
<li>For BM / VM backups, read:</li>
<ul>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/backingupOS.htm" target="_blank">Backing Up to Oracle Cloud Infrastructure Object Storage</a></li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/backingupFRA.htm" target="_blank">Backing Up to Local Storage Using the Database CLI</a> (only applicable to BM databases)</li>
</ul>
</ul>
</ul>
<li><b>Backup Options</b></li>
<ul>
<li>Automatic <b>incremental</b>―Runs once a day; repeats the cycle every week; retained for 30 days after you terminate the DS<sup>[11]</sup></li>
<li><b>Full </b>backups―On-demand, standalone<sup>[10]</sup></li>
</ul>
<li><b>Restore Options</b></li>
<ul>
<li>To the latest</li>
<li>To the timestamp</li>
<li>To <a href="https://asktom.oracle.com/pls/asktom/f?p=100:11:0::::P11_QUESTION_ID:48052838748707" target="_blank">System Change Number</a> (SCN)</li>
</ul>
</ul>
<div>
<br />
<b><u>Manged Backups vs. Unmanaged Backups</u></b></div>
<ul style="text-align: left;">
<li><b>Managed backups</b></li>
<ul>
<li>See <a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/backingupOS.htm">Backing Up to Oracle Cloud Infrastructure Object </a></li>
</ul>
<li><b>Unmanaged backups</b></li>
<ul>
<li>The list of backups you see in the Console does not include any unmanaged backups (backups created directly by using <a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/backingupOSrman.htm?Highlight=RMAN" target="_blank">RMAN</a> or <a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/backingupFRA.htm" target="_blank">dbcli</a>).</li>
</ul>
</ul>
<div>
<br />
<b><u>Automatic Backups (Incremental)</u></b><br />
<ul style="text-align: left;">
<li>Default Policy </li>
<ul>
<li>Not changeable at this time</li>
<li>Are written to Oracle owned object storage (not visible to customers)</li>
<li>Backup window is defined by Oracle</li>
<ul>
<li>New backup window time will be between midnight and 6 AM in the time zone of the DS's region</li>
</ul>
<ul>
<li>To migrate yours to the new behavior, contact Oracle Support </li>
</ul>
<li>All backups are encrypted with the same master key used for <a href="https://en.wikipedia.org/wiki/Transparent_Data_Encryption" target="_blank">Transparent Data Encryption</a> (TDE) wallet encryption. </li>
</ul>
<li>Automatically retried</li>
<ul>
<li>Oracle will get notified if the job is stuck</li>
</ul>
</ul>
<br />
<h3>
High Availability (HA)</h3>
<ul style="text-align: left;">
<li><b>Cloud Infrastructure HA</b></li>
<ul>
<li>Region with 3 <a href="https://docs.cloud.oracle.com/iaas/Content/General/Concepts/regions.htm?Highlight=Availability%20Domain" target="_blank">Availability Domain</a> architecture</li>
<ul>
<li>While the <u>availability domains</u> provide the facility for <b>high availability</b>, <u>regions </u>provide the basis for <b>disaster recovery</b>. </li>
</ul>
<li>Fully redundant and non-blocking Networking Fabric</li>
</ul>
<li><b>Database HA</b></li>
<ul>
<li><b>Disk Redundancy</b></li>
<ul>
<li>Normal (2-way mirroring) vs High (3-way mirroring―recommended for production) </li>
</ul>
<li>Database <a href="https://www.oracle.com/database/technologies/rac.html" target="_blank">RAC</a> option</li>
<li>Automated <a href="https://docs.oracle.com/cd/B19306_01/server.102/b14239/concepts.htm#g1049956" target="_blank">Data Guard</a> within and across <a href="https://docs.cloud.oracle.com/iaas/Content/General/Concepts/regions.htm?Highlight=Availability%20Domain" target="_blank">AD</a>s</li>
</ul>
</ul>
Read Oracle's <a href="https://cloud.oracle.com/iaas/whitepapers/best-practices-deploying-ha-architecture-oci.pdf" target="_blank">whitepaper</a> on HA for more information.<br />
<br />
<div>
<h3>
Scalability</h3>
</div>
<ul style="text-align: left;">
<li><b>Exadata </b></li>
<ul>
<li>Two kinds of scaling operations are supported for an Exadata DB system:</li>
<ul>
<li>Scaling <b>within an Exadata DS</b> lets you modify compute node processing power within the system.</li>
<li>Scaling <b>across Exadata DS</b> configurations lets you move to a different configuration, for example, from a <span face=""arial" , sans-serif" style="background-color: white; color: #222222; font-size: x-small;">¼</span> to a <span face=""arial" , sans-serif" style="background-color: white; color: #222222; font-size: x-small;">½ </span>rack.</li>
</ul>
<li>To learn how to scale an Exadata DS, see <a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/exalaunchingDB.htm#scale">To scale an Exadata DB system</a>.</li>
</ul>
<li><b>Bare Metal </b></li>
<ul>
<li># of CPU cores can be scaled</li>
<li>Total <b>raw storage</b> is fixed based on a chosen shape</li>
<ul>
<li>However, the amount of <b>usable storage</b> on the BM DS can be affected by options like <u>2- or 3-way mirroring</u> and <u>the space allocated for data files</u>.</li>
</ul>
</ul>
<li><b>Virtual Machine </b></li>
<ul>
<li>1-node or 2-node RAC </li>
<li>Storage can be scaled</li>
<ul>
<li>For 2-node RAC VM DB systems, storage capacity is shared between the nodes.</li>
</ul>
<li># of CPU cores on an existing VM DS cannot be changed.</li>
</ul>
</ul>
<div>
<br /></div>
<div>
<h3>
References</h3>
<ol>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Database/Concepts/databaseoverview.htm" target="_blank">Overview of Database Service</a> (OCI)</li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/recoveringOS.htm?Highlight=Full%20backup" target="_blank">Recovering a Database from Object Storage</a></li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/devtoolshome.htm" target="_blank">Developer Tools</a> (OCI)</li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/updatingDB.htm" target="_blank">Updating a DB System</a> (OCI)</li>
<ul>
<li>Includes information and instructions on how to update the OS of a bare metal or virtual machine DB system.</li>
</ul>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/exatooling.htm" target="_blank">Updating an Exadata DB System</a> (OCI)</li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Security/Reference/dbaas_security.htm" target="_blank">Securing Database</a> (OCI)</li>
<ul>
<li>Includes information on security best practices for databases in Oracle Cloud Infrastructure.</li>
</ul>
<li>OCI Database Service Troubleshooting </li>
<ul>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Database/Troubleshooting/Backup/backupfail.htm">Backup Failures</a></li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Database/Troubleshooting/Patching/patchingfail.htm">Patching Failures</a></li>
</ul>
<li><a href="https://cloud.oracle.com/storage/object-storage/faq" target="_blank">Oracle Cloud Infrastructure Object Storage FAQ</a></li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Database/References/dbacli.htm?Highlight=dbcli" target="_blank">Oracle Database CLI Reference</a> (dbcli)</li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/backingupOS.htm?Highlight=standalone" target="_blank">Standalone Backups</a> (OCI)</li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/backingupOS.htm">Backing Up to Oracle Cloud Infrastructure Object </a> (OCI)</li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/migrating.htm?Highlight=data%20pump" target="_blank">Migrating Databases to the Cloud</a> (OCI)</li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/devtoolshome.htm" target="_blank">Developer Tools</a> (OCI)</li>
<li><a href="https://docs.oracle.com/en/database/oracle/oracle-database/12.2/ostmg/asm-intro.html#GUID-BC612D35-5399-4A35-843E-CF76E3D3CDB5" target="_blank">Introduction to Oracle Automatic Storage Management</a> (ASM)</li>
<li><a href="https://cloud.oracle.com/iaas/whitepapers/best-practices-deploying-ha-architecture-oci.pdf" target="_blank">Best Practices for Deploying High Availability Architecture on Oracle Cloud Infrastructure</a> (must read)</li>
<li><a href="https://docs.cloud.oracle.com/iaas/api/#/" target="_blank">OCI API Documentation</a> </li>
</ol>
</div>
</div>
</div>
Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com1tag:blogger.com,1999:blog-748094882401183761.post-63575683538110602512019-01-18T12:32:00.001-06:002021-12-16T10:59:25.958-06:00OCI―Knowing File Storage Service Basics<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;"><iframe width="560" height="315" src="https://www.youtube.com/embed/hDuBneYkem8" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe></div>
<div style="text-align: center;">
<span style="font-family: inherit;"><b>Video 1. </b>OCI Level 100 - File Storage (<a href="https://www.youtube.com/watch?v=hDuBneYkem8" target="_blank">Demo</a> starts at 23:00)</span></div>
<br />
<br />
<a href="https://docs.cloud.oracle.com/iaas/Content/GSG/Concepts/concepts.htm">Oracle Cloud Infrastructure</a> (<b>OCI</b>) <a href="https://docs.cloud.oracle.com/iaas/Content/File/Concepts/filestorageoverview.htm" target="_blank">File Storage Service</a> (<b>FSS</b>) is a managed file storage service that<br />
<ul style="text-align: left;">
<li>Provides a durable, scalable, distributed, enterprise-grade network file system.</li>
<ul>
<li>Using industry-standard <a href="https://en.wikipedia.org/wiki/Network_File_System">Network File System</a>
(NFSv3) file access protocols and file system semantics</li>
<li>You can start with a file system that
contains only a few kilobytes (KB) of data and scale to exabytes (EB) of data without upfront provisioning. </li>
<li>It protects your data by maintaining multiple <b>replicas</b>, providing
transparent <b>encryption</b>, and enabling frequent <a href="https://docs.cloud.oracle.com/iaas/Content/File/Tasks/managingsnapshots.htm">snapshots</a>.</li>
</ul>
<li>Can be accessed concurrently by thousands of <a href="http://xmlandmore.blogspot.com/2019/01/ociknowing-compute-service-basics.html" target="_blank">compute instances</a></li>
<ul>
<li>You can connect to a FSS file system from any bare metal, virtual machine, or container instance in your <a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-virtual-cloud-network-basics.html">Virtual Cloud Network</a> (VCN)</li>
<li>You can also access a file system from outside the VCN using Oracle Cloud Infrastructure FastConnect and Internet Protocol security (IPSec) virtual private network (VPN)</li>
</ul>
</ul>
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg4eCHzHdwtbgQO_S6-jKNIrcDlJP9B4EUm4STOrHaLZwbrUlwgPt9TiVaLZnivowvE3UZfGIIhB30HDN0jf2iABYRXmAubLK_TejXpyDIapNQ3bYdu7AhmwbqJi1rbXbuYyEl8ZRlZtLO5/s1600/FileStorage.jpg" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="323" data-original-width="720" height="250" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg4eCHzHdwtbgQO_S6-jKNIrcDlJP9B4EUm4STOrHaLZwbrUlwgPt9TiVaLZnivowvE3UZfGIIhB30HDN0jf2iABYRXmAubLK_TejXpyDIapNQ3bYdu7AhmwbqJi1rbXbuYyEl8ZRlZtLO5/s640/FileStorage.jpg" width="560" /></a></div>
<br />
<div>
<h3>
FSS Security</h3>
<div>
<br />
You create users and groups in OCI. Then, you can use policies to specify which users and groups can create, access, or modify resources such as <a href="https://docs.cloud.oracle.com/iaas/Content/File/Tasks/creatingfilesystems.htm">file systems</a>, <a href="https://docs.cloud.oracle.com/iaas/Content/File/Tasks/managingmounttargets.htm">mount targets</a>, and <a href="https://docs.cloud.oracle.com/iaas/Content/File/Tasks/exportoptions.htm">export options</a>.</div>
<div>
<br /></div>
There are four distinct and separate layers of security to consider when using the FSS. Each layer has its own authorization entities and methods which are separate from the other layers.<br />
<br />
<table align="center" cellspacing="0" class="TableStyle-Grid" style="background-color: white; border-collapse: collapse; border-color: rgb(128, 128, 128); border-spacing: 0px; border-style: solid; border-width: 2px; color: #666666; font-family: "Helvetica Neue", -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, Oxygen-Sans, Ubuntu, Cantarell, sans-serif; font-size: 12px; margin-bottom: 0px;" summary="This table summarizes the three security layers in File Storage, and what methods are used to control actions."> <colgroup><col width="100"></col>
<col width="100"></col><col width="360"></col></colgroup><thead>
<tr class="TableStyle-Grid-Head-Header" style="border-top: 1px solid rgb(196, 206, 215);"><th class="TableStyle-Grid-HeadE-Column1-Header" scope="col" style="border: 1px solid rgb(196, 206, 215); padding: 16px 12px; text-align: left; vertical-align: bottom;">This security layer...</th><th class="TableStyle-Grid-HeadE-Column1-Header" scope="col" style="border: 1px solid rgb(196, 206, 215); padding: 16px 12px; text-align: left; vertical-align: bottom;">Uses these...</th><th class="TableStyle-Grid-HeadD-Column1-Header" style="border: 1px solid rgb(196, 206, 215); padding: 16px 12px; text-align: left; vertical-align: bottom;">To control actions like...</th></tr>
</thead><tbody>
<tr class="TableStyle-Grid-Body-Row1" style="border-top: 1px solid rgb(196, 206, 215); transition: background-color 0.1s linear 0s;"><th class="TableStyle-Grid-BodyE-Column1-Row1" scope="row" style="border: 1px solid rgb(196, 206, 215); padding: 16px 12px; text-align: left; vertical-align: top;"><a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-identity-and-access.html">IAM Service</a></th><td class="TableStyle-Grid-BodyE-Column1-Row1" style="border: 1px solid rgb(196, 206, 215); padding: 16px 12px; vertical-align: top;"><b>OCI Users</b> and policies</td><td class="TableStyle-Grid-BodyD-Column1-Row1" style="border: 1px solid rgb(196, 206, 215); padding: 16px 12px; vertical-align: top;">Creating instances (NFS clients) and VCNs. Creating, listing, and associating file systems and mount targets.</td></tr>
<tr class="TableStyle-Grid-Body-Row1" style="border-top: 1px solid rgb(196, 206, 215); transition: background-color 0.1s linear 0s;"><th class="TableStyle-Grid-BodyE-Column1-Row1" scope="row" style="border: 1px solid rgb(196, 206, 215); padding: 16px 12px; text-align: left; vertical-align: top;"><a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-virtual-cloud-network-basics.html">Network Security</a></th><td class="TableStyle-Grid-BodyE-Column1-Row1" style="border: 1px solid rgb(196, 206, 215); padding: 16px 12px; vertical-align: top;">IP addresses, CIDR blocks, security lists</td><td class="TableStyle-Grid-BodyD-Column1-Row1" style="border: 1px solid rgb(196, 206, 215); padding: 16px 12px; vertical-align: top;">Connecting the client instance to the mount target. This is on an ‘<span style="color: red;">all or nothing</span>’ basis - the client either can or cannot access the mount target, and therefore all file systems associated with it.</td></tr>
<tr class="TableStyle-Grid-Body-Row1" style="border-top: 1px solid rgb(196, 206, 215); transition: background-color 0.1s linear 0s;"><th class="TableStyle-Grid-BodyE-Column1-Row1" scope="row" style="border: 1px solid rgb(196, 206, 215); padding: 16px 12px; text-align: left; vertical-align: top;">NFS export options</th><td class="TableStyle-Grid-BodyE-Column1-Row1" style="border: 1px solid rgb(196, 206, 215); padding: 16px 12px; vertical-align: top;">File system exports, IP addresses, Unix users</td><td class="TableStyle-Grid-BodyD-Column1-Row1" style="border: 1px solid rgb(196, 206, 215); padding: 16px 12px; vertical-align: top;">Applying access control per-file system based on source IP CIDR blocks that bridges the Security Lists layer and the NFS v.3 Unix Security layer. See <a href="https://docs.cloud.oracle.com/iaas/Content/File/Tasks/exportoptions.htm">Working with NFS Export Options</a> to specify <span style="color: red;">granular controls on a per-file system basis</span>.</td></tr>
<tr class="TableStyle-Grid-Body-Row1" style="border-top: 1px solid rgb(196, 206, 215); transition: background-color 0.1s linear 0s;"><th class="TableStyle-Grid-BodyB-Column1-Row1" scope="row" style="border: 1px solid rgb(196, 206, 215); padding: 16px 12px; text-align: left; vertical-align: top;"><a href="https://support.microfocus.com/kb/doc.php?id=7021756">NFS v.3 Unix security</a></th><td class="TableStyle-Grid-BodyB-Column1-Row1" style="border: 1px solid rgb(196, 206, 215); padding: 16px 12px; vertical-align: top;"><b>Unix users</b>, file mode bits</td><td class="TableStyle-Grid-BodyA-Column1-Row1" style="border: 1px solid rgb(196, 206, 215); padding: 16px 12px; vertical-align: top;">Mounting file systems, reading and writing files.</td></tr>
</tbody></table>
</div>
<div>
<br /></div>
<b><u>Unix User ≠ OCI User</u></b><br />
<div>
<br /></div>
<div>
Remember that <b>users in UNIX</b> aren’t the same as <b>users in OCI</b> - they’re <span style="color: red;">not linked or associated</span> in any way. The OCI policy layer doesn’t govern anything that happens <u>inside the file system</u>, the UNIX security layer does. Conversely, the UNIX security layer doesn’t govern <u>creating file systems or mount targets in OCI</u>.<br />
<br />
<div>
<h3>
Mount Target</h3>
<div>
<br /></div>
<div>
<a href="https://docs.cloud.oracle.com/iaas/Content/File/Tasks/managingmounttargets.htm" target="_blank">Mount Target</a> is an <b>NFS endpoint</b> that lives in a <b>subnet</b>. It has the following features:</div>
<ul style="text-align: left;">
<li>Must be in the same <a href="https://docs.cloud.oracle.com/iaas/Content/General/Concepts/regions.htm">availability domain</a> as the file system.</li>
<ul>
<li>When you create a file system, you can create a <a href="https://docs.cloud.oracle.com/iaas/Content/File/Tasks/managingmounttargets.htm" target="_blank">mount target</a> or use an existing one.</li>
</ul>
<li>Each mount target has an <b>export set</b></li>
<ul>
<li>A collection of one or more exports that control what file systems the mount target exports using NFSv3 protocol and how those file systems are found using the NFS mount protocol. </li>
<li>The information stored in an <b>export</b> includes the file system OCID, export path, and export options. For more information, see <a href="https://docs.cloud.oracle.com/iaas/Content/File/Tasks/exportoptions.htm">Working with NFS Export Options</a>.</li>
<li>Exports and export sets are managed through the Console by the FSS. More advanced configuration options for exports and export sets are available in the <a href="https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/cliusing.htm?Highlight=jmespath" target="_blank">Command Line Interface</a> (CLI) and <a href="https://docs.cloud.oracle.com/iaas/api/#/" target="_blank">API</a>.</li>
</ul>
<li>Provides the IP address or DNS name that is used in the mount command when connecting NFS clients to the FSS. </li>
<li>Requires three private IP addresses in the subnet (don't use /30 or smaller subnets for the FSS)</li>
<li>Should be placed in its own subnet</li>
<ul>
<li>Placing NFS clients and mount target in the same subnet can result in IP conflicts, as users are not shown which private IP;s are used for mount target.</li>
</ul>
<li>Mount Target Limits</li>
<ul>
<li>By default, you can create <u>two mount targets per account per availability domain.</u></li>
</ul>
</ul>
<br />
<h3>
File System</h3>
<br />
<a href="https://docs.cloud.oracle.com/iaas/Content/File/Tasks/creatingfilesystems.htm">File System</a> is a way that your Compute instances use to organize files on your storage. You can create a shared file system in the cloud using the FSS. To access your file systems, you need to create a new (or use an existing) mount target.<br />
<br />
When you use the Cloud Console, creating a file system also creates a <a href="https://docs.cloud.oracle.com/iaas/Content/File/Tasks/managingmounttargets.htm" target="_blank">mount target</a> that your <a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-compute-service-basics.html" target="_blank">Compute instances</a> use to access and write to the file system. Once set up, file systems can be accessed from any OCI <a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-compute-service-basics.html">BM/VM instance</a> in the same or other <a href="https://docs.cloud.oracle.com/iaas/Content/General/Concepts/regions.htm?Highlight=availability%20domain" target="_blank">regions</a>. They can also be accessed from your on-premise environment using <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Concepts/fastconnect.htm?Highlight=FastConnect" target="_blank">FastConnect</a> or <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/workingwithIPsec.htm?Highlight=IPSec%20VPN" target="_blank">IPSec VPN</a>.<sup>[3]</sup><br />
<br />
<b><u>1 Mount Target : N File systems</u></b><br />
<br />
Using the <a href="https://docs.cloud.oracle.com/iaas/api/#/" target="_blank">API </a>or the <a href="https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/cliusing.htm?Highlight=jmespath" target="_blank">Command Line Interface</a> (CLI), you can create <a href="https://docs.cloud.oracle.com/iaas/Content/File/Tasks/creatingfilesystems.htm">file systems</a> and <a href="https://docs.cloud.oracle.com/iaas/Content/File/Tasks/managingmounttargets.htm">mount targets</a> <u>independently of each other</u>. Both file systems and mount targets are associated with an <a href="https://docs.cloud.oracle.com/iaas/Content/General/Concepts/regions.htm">availability domain</a>.<br />
<br />
Once <u>a mount target</u> is created, <u>multiple file systems</u> can be associated with it. You can create up to 100 file systems per mount target. However, no two file systems associated with the same mount target can have overlapping <a href="https://docs.cloud.oracle.com/iaas/Content/File/Concepts/filesystempaths.htm?Highlight=export%20path">export path</a> (e.g., FS paths like <span style="background-color: #fce5cd; font-family: "courier new" , "courier" , monospace; font-size: x-small;">/example</span> and <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;"><span style="background-color: #fce5cd;">/example</span>/path</span> are not allowed)<br />
<br />
<h3>
Paths in File Systems</h3>
<br />
In the discussions below, we will use this mount command example:<br />
<blockquote class="tr_bq">
<span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">sudo mount 10.0.0.6:/example/path /mnt/mountpointA</span> </blockquote>
<blockquote class="tr_bq">
where </blockquote>
<blockquote class="tr_bq">
<span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">10.0.0.6</span> is the mount <b>target IP address</b> and <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">/example/path</span> is the <a href="https://docs.cloud.oracle.com/iaas/Content/File/Concepts/filesystempaths.htm?Highlight=export%20path" target="_blank">export path</a></blockquote>
There are three kinds of paths that are used in the FSS:<br />
<div>
<ul style="text-align: left;">
<li><b>Export Paths</b></li>
<ul>
<li>Specified when a file system is associated with a mount target</li>
<li>Appended to the mount target IP address, and used to <u>mount (logically attach)</u> to the file system</li>
<li>Used <u>only to distinguish one file system from another within a single mount target</u></li>
<li>Syntax Rules</li>
<ul>
<li>Must start with a slash (/) followed by a sequence of zero or more slash-separated elements.</li>
<li>Cannot end in a slash</li>
<li>Cannot be a period (.) or two periods in sequence (..)</li>
<li>Cannot exceed 255 bytes</li>
</ul>
</ul>
<li><b>Mount Point Paths</b></li>
<ul>
<li>Are <u>paths within a client instance</u> to a locally accessible directory <u>to which the remote file system is mounted</u></li>
<li><span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">/mnt/mountpointA</span> is the path to the directory on the client instance on which the external file system is mounted.</li>
</ul>
<li><b>File System Paths</b></li>
<ul>
<li>Are paths to directories within the file system, and contain the contents of the file system. </li>
<li>For example, <a href="https://docs.cloud.oracle.com/iaas/Content/File/Tasks/managingsnapshots.htm">snapshots</a> of the file system can be accessed using the file system path, under the file system's root directory at .snapshot/name.</li>
<ul>
<li>The following example shows the path to a snapshot called 'January 1' when navigating from the instance:</li>
<ul>
<li><span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">/mnt/mountpointA/.snapshot/January1</span></li>
</ul>
</ul>
</ul>
</ul>
<div>
<span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;"><br /></span></div>
</div>
<div>
<h3>
</h3>
<h3>
Creating a File System</h3>
<br />
Follow these steps to create a File System on OCI:<br />
<div style="margin-bottom: 20px; margin-top: 20px;">
<ol style="text-align: left;">
<li>From the <b>Core Infrastructure</b>, select <b>File Storage</b>. </li>
<li>Choose a compartment in which you have permission to work. </li>
<li>Click Create File System. </li>
<li>In the <b>Create File System</b> dialog box, provide the following information: </li>
<ul>
<li>Enter a name for the File System. </li>
<li>Choose an availability domain. </li>
<li>Choose <b>Edit Details </b>for Mount Target</li>
<ul>
<li>Choose <b>CREATE MOUNT TARGET</b> (or you can SELECT AN EXISTING MOUNT TARGET)</li>
<ul>
<li>Enter a name for the Mount Target </li>
<li>Choose a <a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-virtual-cloud-network-basics.html" target="_blank">VCN</a> for Mount Target</li>
<li>Choose a subnet for Mount Target (e.g., <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">FSS-subnet</span> as in the video)</li>
</ul>
<li>Click <b>Show Advanced Options</b> </li>
<ul>
<li>Before you can mount this file system, you must configure security rules to allow traffic to subnet <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">FSS-subnet</span>. </li>
<li>Choose IP ADDRESS</li>
<li>Choose HOSTNAME</li>
<li>Choose PATH</li>
<ul>
<li>Path name cannot be currently in use in the Mount Target</li>
</ul>
<li>Choose MAXIMUM FREE SPACE (IN GiB)</li>
</ul>
</ul>
</ul>
<li>Click <b>Create File System</b>.</li>
</ol>
<div>
<br /></div>
<div>
<b><u>Configuration Details</u></b><br />
<ul style="text-align: left;">
<li><b>File System Information</b></li>
<ul>
<li><b>Name</b></li>
<ul>
<li>The file system name doesn't need to be unique; an <a href="https://docs.cloud.oracle.com/iaas/Content/General/Concepts/identifiers.htm" target="_blank">Oracle Cloud Identifier</a> (OCID) uniquely identifies it.</li>
</ul>
<li><b>Availability domain</b> </li>
<ul>
<li>The <a href="https://docs.cloud.oracle.com/iaas/Content/General/Concepts/regions.htm" target="_blank">availability domain</a> in which you want to run the File System.</li>
</ul>
</ul>
<li><b>Mount Target Information</b></li>
<ul>
<li>File systems must be associated with a mount target in order to be mounted by any instance.</li>
<li>By default, the mount target is created in your current compartment.</li>
<li>The mount target must be in the same availability domain as the file system. You cannot change the availability domain.</li>
<li><b>Virtual Cloud Network</b></li>
<ul>
<li>The first VCN listed in the selected compartment is used as default.</li>
</ul>
<li><b>Subnet</b></li>
<ul>
<li>The first subnet listed in the selected availability domain is used as default.</li>
<li>FSS requires ingress TCP ports 111, 2048,2049, and 2050, in addition to standard ingress UDP ports 111 and 2048. Opening these ports enables traffic from Solaris, Linux, and Windows instances. Read <a href="https://docs.cloud.oracle.com/iaas/Content/File/Tasks/securitylistsfilestorage.htm">Configuring VCN Security List Rules for File Storage</a> for more information.</li>
<li>Don't place NFS client(s) and mount target in the same subnet</li>
</ul>
<li><b>IP Address </b>(Optional)</li>
<ul>
<li>You can specify an unused, local, private IP address, for example, between 10.0.0.2 and 10.0.0.254 for the new mount target.</li>
</ul>
<li><b>Hostname </b>(Optional)</li>
<ul>
<li>You can specify a hostname you want to assign to the mount target.</li>
<li>Which will be used to created a fully qualified domain name (FQDN) which cannot be changed in this dialog.</li>
</ul>
<li><b>Path Name</b> (Optional)</li>
<ul>
<li>You can replace the default <a href="https://docs.cloud.oracle.com/iaas/Content/File/Concepts/filesystempaths.htm?Highlight=export%20path" target="_blank">export path</a> (default path using new file system's name) with a new one.</li>
</ul>
<li><b>Maximum Free Space</b> (in GiB; Optional)</li>
<ul>
<li>Specifies the maximum free space (default: 8 exabytes) reported to applications by the FSS.</li>
<ul>
<li>Some applications fail to install because a capacity check reports too much available capacity (i.e. the default 8 exabytes). </li>
<li>Setting the Maximum Free Space reported as available to a value acceptable by your application prevents this issue. </li>
</ul>
<li>Setting the maximum free space affects each file system associated with the mount target. </li>
<li>Setting the maximum free space <u>does not limit the amount of data you can store</u>.</li>
</ul>
<li><b>Export Options</b> (Important)</li>
<ul>
<li>Enable the "Require Privileged Source Port" export option. For more information, see <a href="https://docs.cloud.oracle.com/iaas/Content/File/Tasks/exportoptions.htm">Working with NFS Export Options</a>.</li>
</ul>
</ul>
</ul>
</div>
<div>
<br /></div>
</div>
<h3>
Summary</h3>
<div>
<br /></div>
<a href="https://docs.cloud.oracle.com/iaas/Content/File/Concepts/filestorageoverview.htm" target="_blank">File Storage Service</a> is an AD-local service, available in all OCI regions and <a href="https://docs.cloud.oracle.com/iaas/Content/General/Concepts/regions.htm" target="_blank">Availability Domains</a>, which supports<br />
<ul style="text-align: left;">
<li><a href="https://tools.ietf.org/html/rfc1813" target="_blank"><b>NFS v.3</b></a></li>
<li><b><a href="https://docs.oracle.com/cd/E36784_01/html/E36825/rfsintro-12.html" target="_blank">Network Lock Management</a> (NLM) for file locking</b></li>
<li><b>Full <a href="https://en.wikipedia.org/wiki/POSIX" target="_blank">POSIX</a> semantics</b></li>
<li><b>Data Protection</b></li>
<ul>
<li>Snapshot capabilities; 10,000 snapshots per file system</li>
</ul>
<li><b>Security</b></li>
<ul>
<li>128-bit, data-at-rest encryption for all file systems & metadata</li>
</ul>
<li><b>Management Options</b></li>
<ul>
<li>Console , <a href="https://docs.cloud.oracle.com/iaas/api/#/" target="_blank">APIs</a>, <a href="https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/cliusing.htm?Highlight=jmespath" target="_blank">CLI</a>, data-path commands, and <a href="https://en.wikipedia.org/wiki/Terraform_(software)" target="_blank">Terraform</a></li>
</ul>
</ul>
You can create 100 file systems and 2 mount targets per AD per account. But you can request an increase. See <a href="https://docs.cloud.oracle.com/iaas/Content/General/Concepts/servicelimits.htm">Service Limits</a> for a list of applicable limits and instructions for requesting a limit increase.</div>
<div>
<br />
<h3>
References</h3>
<ol style="text-align: left;">
<li><a href="https://cloud.oracle.com/en_US/storage/whitepapers" target="_blank">OCI Storage White Papers</a> </li>
<li><a href="https://cloud.oracle.com/opc/iaas/whitepapers/best-practices-deploying-haarchitecture-oci.pdf" target="_blank">Best Practices for Deploying HA Architecture on OCI</a> </li>
<li><a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-virtual-cloud-network-basics.html" target="_blank">OCI―Knowing Virtual Cloud Network Basics</a> (XML and More)</li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/File/Tasks/securitylistsfilestorage.htm">Configuring VCN Security List Rules for File Storage</a> (OCI)</li>
<li><a href="https://cloud.oracle.com/iaas/whitepapers/ebs-deployment-on-oci.pdf" target="_blank">How EBS can be deployed on OCI</a></li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingVCNs.htm">VCNs and Subnets</a> (OCI)</li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/devtoolshome.htm" target="_blank">Developer Tools</a> (OCI)</li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Security/Reference/configuration_%20security.htm" target="_blank">OCI Security Best Practices</a></li>
<li><a href="https://cloud.oracle.com/iaas/whitepapers/vcndeployment-guide.pdf" target="_blank">Learn more about VCNs</a></li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/File/Concepts/securitylayers.htm?Highlight=About%20Security">About Security</a> (OCI)</li>
<li><a href="https://docs.us-phoenix1.oraclecloud.com/Content/GSG/Concepts/baremetalintro.htm" target="_blank">Documentation</a> </li>
<li><a href="https://blogs.oracle.com/cloud-infrastructure/" target="_blank">Blogs</a></li>
<li><a href="https://docs.cloud.oracle.com/iaas/api/#/" target="_blank">API Documentation</a> (OCI)</li>
</ol>
<br />
<br /></div>
</div>
</div>
</div>Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com1tag:blogger.com,1999:blog-748094882401183761.post-27440070382666264972019-01-15T13:01:00.001-06:002021-12-16T12:24:03.385-06:00OCI―Knowing Compute Service Basics<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;"><iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen="" frameborder="0" height="315" src="https://www.youtube.com/embed/tRZrlg7-R1g" title="YouTube video player" width="560"></iframe></div>
<div class="separator" style="clear: both; text-align: center;">
<span><b>Video 1. </b>OCI Core 100 - Compute (<a href="<iframe width="560" height="315" src="https://www.youtube.com/embed/tRZrlg7-R1g" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>" target="_blank">Demo</a> starts at 24:00)</span></div>
<span style="text-align: left;"><br /></span>
<span style="text-align: left;"><a href="https://docs.cloud.oracle.com/iaas/Content/GSG/Concepts/concepts.htm">Oracle Cloud Infrastructure</a> (OCI) <a href="https://docs.cloud.oracle.com/iaas/Content/Compute/Concepts/computeoverview.htm" target="_blank">Compute Service</a> lets you provision and manage compute hosts, known as <b>instances</b>. </span>
<br />
<br />
<h3>
Instance Type</h3>
<br />
OCI offers two types of instances:<br />
<ul style="text-align: left;">
<li><b>Bare Metal</b></li>
<ul>
<li>Gives you dedicated physical server access (<b>single-tenant model</b>) for highest performance and strong isolation</li>
<li>Allows direct hardware access with all the security, capabilities, elasticity and scalability of OCI</li>
</ul>
<li><b>Virtual Machine</b></li>
<ul>
<li>A <a href="https://en.wikipedia.org/wiki/Hypervisor" target="_blank">hypervisor</a> to virtualize the underlying Bare Metal server into smaller VMs (<b>multi-tenant model</b>)</li>
<ul>
<li>The virtualization makes it possible to run multiple VMs that are isolated from each other</li>
<li>VMs are ideal for running applications that do not require the performance and resources (CPU, memory, network bandwidth, storage) of an entire physical machine</li>
</ul>
</ul>
</ul>
Both types of instances are run on the same OCI stacks.<br />
<span style="text-align: left;"><br /></span>
<br />
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiaUhDef1KV_9wX1U3agjNLLJgOTCZmr0zwpmvhku_AsyQEecVKdwVoXeOp3an4boAxvI7d-TjGnL6bgHotJrrejLVxpyh5FvTERavuYka4KxXRVT_8ycspWoJfaiotQdrCafQmA-kwExXw/s1600/BM_instances.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="193" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiaUhDef1KV_9wX1U3agjNLLJgOTCZmr0zwpmvhku_AsyQEecVKdwVoXeOp3an4boAxvI7d-TjGnL6bgHotJrrejLVxpyh5FvTERavuYka4KxXRVT_8ycspWoJfaiotQdrCafQmA-kwExXw/s1600/BM_instances.jpg" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 1. Bare Metal Instances</b></td></tr>
</tbody></table>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh7iCSdfiWTcVIjubdcochzivtvIKh5HSX2vbndScsd051GE9U0xNPNx7PPX_QhcLfg35R2xcKzVjR3wT6oPDkv4bJ1W2xMgG9k37cWwk4CFexKrCvvrFExINyCEQfFJCGOxsg6r6HUf9Xa/s1600/VM_standarad_instances.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="295" data-original-width="720" height="230" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh7iCSdfiWTcVIjubdcochzivtvIKh5HSX2vbndScsd051GE9U0xNPNx7PPX_QhcLfg35R2xcKzVjR3wT6oPDkv4bJ1W2xMgG9k37cWwk4CFexKrCvvrFExINyCEQfFJCGOxsg6r6HUf9Xa/s640/VM_standarad_instances.jpg" width="560" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 2. VM Standard Instances (Intel X7 & AMD)</b></td></tr>
</tbody></table>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj4sxUpahQUAadyDvkTVy32Ne9wL5RprG7L1QusIwowxLW5o6SkYv2T44n_ipzXJ-GiaZMAKTFy7vJNwMZApLVxAcsuz8klyRBMdieRzqL_nr57BR9QyuwtlkmnwRbEr-pxfBEQp-dSPUCK/s1600/VM_DenseIO_instances.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="102" data-original-width="720" height="104" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj4sxUpahQUAadyDvkTVy32Ne9wL5RprG7L1QusIwowxLW5o6SkYv2T44n_ipzXJ-GiaZMAKTFy7vJNwMZApLVxAcsuz8klyRBMdieRzqL_nr57BR9QyuwtlkmnwRbEr-pxfBEQp-dSPUCK/s640/VM_DenseIO_instances.jpg" width="560" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 3. VM Dense I/O Instances</b></td></tr>
</tbody></table>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhNQ5yf4bDAiQjO1xkIL9QTxOBfn0eiW58ScG00CFBhtplgH289jjLuOhWLUbExnK-Fy2QfVk0DksWYkgRTd_St8CwaBPeJxLgVDrJ_eqOFLIzZnVj2LDsTawQ6LVsQq7i9-mm-sYfT-iN0/s1600/GPU_Instances.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="204" data-original-width="720" height="158" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhNQ5yf4bDAiQjO1xkIL9QTxOBfn0eiW58ScG00CFBhtplgH289jjLuOhWLUbExnK-Fy2QfVk0DksWYkgRTd_St8CwaBPeJxLgVDrJ_eqOFLIzZnVj2LDsTawQ6LVsQq7i9-mm-sYfT-iN0/s640/GPU_Instances.jpg" width="560" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 4. GPU Instances (BM and VM)</b></td></tr>
</tbody></table>
<div>
<br /></div>
<div>
<h3>
</h3>
<h3>
Instance Shape</h3>
<br />
A <a href="https://docs.cloud.oracle.com/iaas/Content/Compute/References/computeshapes.htm?Highlight=Instance%20Shape" target="_blank">shape</a> is a template that determines the number of CPUs, amount of memory, and other resources allocated to a newly created instance. OCI Compute Service enables you to select from a range of predefined shapes for both Bare Metal (<b>BM</b>) and Virtual Machine (<b>VM</b>) instances (see Figure 1-4):<br />
<ul style="text-align: left;">
<li>Compute Standard E2 is based on <a href="http://ir.amd.com/news-releases/news-release-details/amd-and-oracle-collaborate-provide-amd-epyctm-processor-based" target="_blank">AMD EPYC<sup><span style="font-family: "courier new" , "courier" , monospace;">TM</span></sup> processor</a></li>
<li>2 x 25 Gbps implies two <a href="https://en.wikipedia.org/wiki/Network_interface_controller" target="_blank">NIC</a> cards with 25 Gbps bandwidth</li>
<li>Network bandwidth is based on expected bandwidth for traffic within a <a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-virtual-cloud-network-basics.html" target="_blank">VCN</a></li>
<li>Max vNICs numbers are for Linux</li>
<li>GPU (Nvdia)<sup>[2]</sup></li>
<ul>
<li><a href="https://en.wikipedia.org/wiki/Volta_(microarchitecture)" target="_blank">Volta</a> is based on Tesla Volta GPUs</li>
<li><a href="https://en.wikipedia.org/wiki/Pascal_(microarchitecture)" target="_blank">Pascal</a> is based on Tesla Pascal GPUs</li>
</ul>
<li>VM standard vs VM Dense IO
shapes</li>
<ul>
<li>VM Dense IO will provide <a href="https://en.wikipedia.org/wiki/NVM_Express" target="_blank">NVMe</a> drivers and VM Standard will
provide block storage only</li>
</ul>
</ul>
<div>
<br /></div>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgpOC80l1B_WM60eK6KYqvLvGkwY2Xn0T3OQ3MjDc_z0wunN1HMAe-xWsWWLubJbTou83Y-Y6z6zCw9UX4tp8SsuOSmZcZ-ejL-fJumob9EUkrvr9viLx69kIhupZtAFDSLqLLx0xqwtvCO/s1600/Compute_Images.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="409" data-original-width="720" height="316" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgpOC80l1B_WM60eK6KYqvLvGkwY2Xn0T3OQ3MjDc_z0wunN1HMAe-xWsWWLubJbTou83Y-Y6z6zCw9UX4tp8SsuOSmZcZ-ejL-fJumob9EUkrvr9viLx69kIhupZtAFDSLqLLx0xqwtvCO/s640/Compute_Images.jpg" width="560" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 5. Image Tab for Selecting the Image Build (highlighted: Oracle Images)</b></td></tr>
</tbody></table>
<h3>
</h3>
<h3>
Instance Image</h3>
<div>
<br />
An image is a template of a virtual hard drive. The image determines the operating system and other software for an instance. </div>
<div>
<br />
On the Image tab (see Figure 5) you can optionally change the image build. By default, the latest build of the image is used to create the instance. You can select an older build of the image that is compatible with the shape you selected. Only compatible image builds are displayed in the list. You <u>need to select a shape before you can change the image build</u>.<br />
<br />
The following images of different categories can be browsed on OCI Console:<br />
<ul style="text-align: left;">
<li><b>Platform Images</b></li>
<ul>
<li>Pre-built images for Oracle Linux, Microsoft Windows, Ubuntu and CentOS</li>
<ul>
<li>Linux Images</li>
<ul>
<li>Default set of firewall rules allow only SSH access (port 22)</li>
<ul>
<li>Users (e.g. <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">opc</span> for Oracle/CentOS or <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">ubuntu</span> for Ubuntu) with <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">sudo</span> privileges are created automatically for instances and are configured for remote access over the SSH v2</li>
</ul>
<li>Provide a startup script using <a href="https://cloudinit.readthedocs.io/en/latest/topics/format.html" target="_blank">cloud-init</a></li>
</ul>
<li>Windows Images</li>
<ul>
<li>User name <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">opc</span> created automatically with an one-time password</li>
<li>Include the Windows Update utility to get the latest Windows updates from Microsoft</li>
</ul>
</ul>
<li>See <a href="https://docs.cloud.oracle.com/iaas/Content/Compute/References/images.htm?Highlight=oracle-provided%20images" target="_blank">Oracle-provided images</a> for more information</li>
</ul>
<li><b>Oracle Images</b></li>
<ul>
<li>Pre-built Oracle enterprise images and solutions enabled for OCI</li>
</ul>
<li><b>Partner Images</b></li>
<ul>
<li>Trusted third-party images published by Oracle partners</li>
</ul>
<li><b>Custom Images</b></li>
<ul>
<li>Custom images created (from an instance's boot disk) or imported into your OCI environment. </li>
<ul>
<li>When you create an image of a running instance, the instance shuts down and remains
unavailable for several minutes. When the process is complete, the instance restarts.
</li>
<li>Instances you launch from your custom image include customization, configuration, and software installed when you create the image</li>
<li>Custom images do not include the data from any attached block volumes</li>
<li>A custom image cannot exceed 300 GB</li>
</ul>
<li>See <a href="https://docs.cloud.oracle.com/iaas/Content/Compute/Tasks/managingcustomimages.htm?Highlight=Managing%20Custom%20Images" target="_blank">Managing Custom Images</a> for more details.</li>
</ul>
<li><b>Boot Volumes</b></li>
<ul>
<li>See <a href="https://docs.cloud.oracle.com/iaas/Content/Block/Concepts/bootvolumes.htm">Boot Volumes</a> for more information.</li>
</ul>
<li><b>Image OCID</b></li>
<ul>
<li>Create an instance using a specific version of an image by its OCID. </li>
<li>See <a href="https://docs.cloud.oracle.com/iaas/Content/Compute/References/imagereleasenotes.htm">Oracle-Provided Image Release Notes</a> to determine the image OCID for Oracle-provided images.</li>
</ul>
</ul>
</div>
<div>
<b><u>Image Import/Export</u></b><br />
<blockquote class="tr_bq">
Read this Oracle <a href="https://cloud.oracle.com/iaas/whitepapers/deploying_custom_os_images.pdf" target="_blank">whitepaper</a> for more details.</blockquote>
<br /></div>
<h3>
Creating an Instance from a Custom Image</h3>
<br />
Follow these steps to launch a virtual machine instance on OCI by using a previously created custom image:
<br />
<div style="margin-bottom: 20px; margin-top: 20px;">
<ol style="text-align: left;">
<li>From the <b>Compute </b>tab, select <b>Instances</b>. </li>
<li>Choose a compartment in which you have permission to work. </li>
<li>Click Create Instance. </li>
<li>In the <b>Create Instance</b> dialog box, provide the following information: </li>
<ul>
<li>Enter a name for the instance. </li>
<li>Choose an availability domain. </li>
<li>Choose <b>Change Image Source</b></li>
<li>Choose <b>Custom Image</b> as the boot volume. </li>
<li>Choose the custom image to use. </li>
<li>Choose <b>Virtual Machine</b> as the instance type.</li>
<li>Choose a shape (only compatible shapes are available). </li>
<li>Configure Boot Volume</li>
<ul>
<li>You can change boot volume size and/or choose a key from <a href="https://xmlandmore.blogspot.com/2018/12/oracle-cloud-infrastructureoci-key.html">Key Management</a> to encrypt this volume</li>
</ul>
<li>Choose to upload or paste SSH keys (public keys). </li>
<li>Choose a <a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-virtual-cloud-network-basics.html" target="_blank">VCN</a>. </li>
<li>Choose a subnet. </li>
</ul>
<li>Click <b>Create Instance</b>.</li>
</ol>
<br />
<b><u>Configuration Details</u></b><br />
<ul style="text-align: left;">
<li><b>Name</b></li>
<ul>
<li>You can add or change instance name later. The name doesn't need to be unique; an <a href="https://docs.cloud.oracle.com/iaas/Content/General/Concepts/identifiers.htm" target="_blank">Oracle Cloud Identifier</a> (OCID) uniquely identifies the instance.</li>
</ul>
<li><b>Availability domain</b> </li>
<ul>
<li>The <a href="https://docs.cloud.oracle.com/iaas/Content/General/Concepts/regions.htm" target="_blank">availability domain</a> in which you want to run the instance.</li>
</ul>
<li><b>Image Source</b></li>
<ul>
<li>When you click <b>Change Image Source</b>, the <b>Browse All Images</b> dialog opens with the operating system or image source options. The following options are available:</li>
<ul>
<li>Platform Images, Partner Images, Oracle Images, Custom Images, Boot Volumes, Image OCID</li>
</ul>
</ul>
<li><b>Instance Type</b></li>
<ul>
<li>Select <b>Virtual Machine</b> or <b>Bare Metal Machine</b>.</li>
</ul>
<li><b>Instance Shape</b></li>
<ul>
<li>When you click <b>Change Shape</b>, the <b>Browse All Shapes</b> dialog opens and is populated with the list of available VM or bare metal shapes based on what you selected for instance type.</li>
<li>See <a href="https://docs.cloud.oracle.com/iaas/Content/Compute/References/computeshapes.htm">Compute Shapes</a> for a list of the available bare metal and VM shapes. </li>
</ul>
<li><b>Boot Volume Size</b></li>
<ul>
<li>The specified size must be larger than the selected image's default boot volume size.</li>
<li>See <a href="https://docs.cloud.oracle.com/iaas/Content/Block/Concepts/bootvolumes.htm#Custom">Custom Boot Volume Sizes</a> for more information.</li>
</ul>
<li><b>Encryption</b></li>
<ul>
<li>Boot volumes are encrypted by default but you can optionally encrypt the data in this volume using your own Key Management encryption key. </li>
<li>See <a href="https://docs.cloud.oracle.com/iaas/Content/KeyManagement/Concepts/keyoverview.htm">Overview of Key Management</a> for more information.</li>
</ul>
<li><b>SSH key</b></li>
<ul>
<li>The public key portion of the key pair you want to use for SSH access to the instance. </li>
</ul>
<li><b>Virtual Cloud Network Compartment</b></li>
<ul>
<li>The compartment containing the network in which to create the instance.</li>
</ul>
<li><b>Virtual Cloud Network</b></li>
<ul>
<li>The network in which to create the instance.</li>
</ul>
<li><b>Subnet Compartment</b></li>
<ul>
<li>The compartment containing a subnet within the cloud network to attach the instance to.</li>
</ul>
<li><b>Subnet</b></li>
<ul>
<li>A subnet within the cloud network to attach the instance to. </li>
<li>The subnets are either <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">public</span> or <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">private</span>. </li>
<ul>
<li>Private means the instances in that subnet can't have public IP addresses. </li>
</ul>
<li>For more information, see <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Concepts/overview.htm#Private">Access to the Internet</a>.</li>
</ul>
<li><b>Fault Domain</b> (Advanced Options)</li>
<ul>
<li>If you do not specify the fault domain, the system selects one for you. </li>
<li>Once the instance has been created, if you want to change the fault domain you need to <u>terminate the instance</u> and launch a new instance in the preferred fault domain. </li>
<li>For more information, see <a href="https://docs.cloud.oracle.com/iaas/Content/General/Concepts/regions.htm#fault">Fault Domains</a> and <a href="https://docs.cloud.oracle.com/iaas/Content/Compute/References/bestpracticescompute.htm">Best Practices for Your Compute Instance</a>. </li>
</ul>
<li><b>User Data</b> (Advanced Options)</li>
<ul>
<li>Data to be used by <a href="https://cloudinit.readthedocs.io/en/latest/topics/format.html" target="_blank">Cloud-Init</a> to run custom scripts or provide custom Cloud-Init configuration. </li>
<li>The file or script does not need to be <a href="https://en.wikipedia.org/wiki/Base64" target="_blank">base64-encoded</a>, as the Console performs this encoding when the information is submitted. For information about how to take advantage of user data, see the <a href="http://cloudinit.readthedocs.io/en/latest/topics/format.html">Cloud-Init Documentation</a>.</li>
</ul>
<li><b>Tags</b> (Optional)</li>
<ul>
<li>To apply a defined tag, you must have permissions to use the tag namespace. </li>
<li>For more information about tagging, see <a href="https://docs.cloud.oracle.com/iaas/Content/General/Concepts/resourcetags.htm">Resource Tags</a>. </li>
</ul>
<li><b>Instance Configuration</b>(Optional)<sup>[5]</sup></li>
<ul>
<li>Instance configurations allow you to define the configuration to use when creating Compute instances as part of an <b>instance pool</b>.</li>
<li>See <a href="https://docs.cloud.oracle.com/iaas/Content/Compute/Concepts/instancemanagement.htm">Managing Compute Instances</a> for more information.</li>
</ul>
<li><b>VNIC </b>(Optional)</li>
<ul>
<li>A VNIC enables an instance to connect to a <a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-virtual-cloud-network-basics.html" target="_blank">VCN</a> and determines how the instance connects with endpoints inside and outside the VCN. </li>
<li>Each instance automatically comes with a primary VNIC, and you can add secondary ones.</li>
<li>See <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingVNICs.htm?Highlight=VNIC" target="_blank">Virtual Network Interface Cards</a> (VNICs) for more information.</li>
</ul>
<li><b>Console Connection </b>(Optional)</li>
<ul>
<li>Enables you to remotely troubleshoot malfunctioning instances</li>
<li>See <a href="https://docs.cloud.oracle.com/iaas/Content/Compute/References/serialconsole.htm" target="_blank">Instance Console Connections</a> for more information.</li>
</ul>
<li><b>Attached Block Volume</b> (Optional)</li>
<ul>
<li>You can attach a block volume to an instance in order to expand the available storage on the instance. </li>
<li>See <a href="https://docs.cloud.oracle.com/iaas/Content/Block/Tasks/attachingavolume.htm" target="_blank">Attaching a Volume</a> for more information.</li>
</ul>
</ul>
<div>
<br /></div>
</div>
</div>
<h3>
References</h3>
<ol>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Compute/Concepts/computeoverview.htm" target="_blank">Compute Service</a> (OCI)</li>
<li><a href="https://blogs.oracle.com/cloud-infrastructure/general-availability-of-virtual-machines-with-nvidia-gpus-on-oracle-cloud-infrastructure" target="_blank">General Availability of Virtual Machines with NVIDIA GPUs on Oracle Cloud Infrastructure</a></li>
<li><a href="https://cloud.oracle.com/iaas/whitepapers/deploying_custom_os_images.pdf" target="_blank">Deploying Custom Operating System Images onOracle Cloud Infrastructure</a></li>
<li><a href="https://xmlandmore.blogspot.com/2018/12/oracle-cloud-infrastructureoci-key.html" target="_blank">Oracle Cloud Infrastructure―OCI Key Management Basics</a></li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Compute/Tasks/creatinginstanceconfig.htm?Highlight=Create%20instance%20configuration%20from%20instance" target="_blank">Creating an Instance Configuration</a> (OCI)</li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/General/Concepts/regions.htm#fault">Fault Domains</a> (OCI)</li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Compute/References/bestpracticescompute.htm">Best Practices for Your Compute Instance</a> (OCI)</li>
<li><a href="http://cloudinit.readthedocs.io/en/latest/topics/format.html">Cloud-Init Documentation</a> (OCI)</li>
</ol>
</div>
Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com1tag:blogger.com,1999:blog-748094882401183761.post-2309898614432122392019-01-14T12:45:00.001-06:002021-12-16T12:27:22.672-06:00OCI―Knowing Block Volume Service Basics<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;"><iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen="" frameborder="0" height="315" src="https://www.youtube.com/embed/2d-Zv8F57ew" title="YouTube video player" width="560"></iframe></div>
<div class="separator" style="clear: both; text-align: center;">
<span><b>Video 1. </b>OCI Level 100 - Block Volume </span><span>(<a href="https://www.youtube.com/watch?v=2d-Zv8F57ew" target="_blank">Demo</a> starts at 27:00)</span></div>
<div>
<br />
<a href="https://docs.cloud.oracle.com/iaas/Content/GSG/Concepts/concepts.htm">Oracle Cloud Infrastructure</a> (<b>OCI </b>) offers two main storage services:<br />
<ul style="text-align: left;">
<li><b><a href="https://docs.cloud.oracle.com/iaas/Content/Block/Concepts/overview.htm?Highlight=block%20storage" target="_blank">Block Volume Service</a></b></li>
<ul>
<li>Integrates with <a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-identity-and-access.html" target="_blank">IAM</a> for authentication and authorization, for all interfaces (the Console, SDK or <a href="https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/cliusing.htm?Highlight=jmespath" target="_blank">CLI</a>, and REST API)</li>
<li>Block storage operates at the raw storage device level and manages data as a set of
numbered, fixed-size blocks using protocols such as <a href="https://en.wikipedia.org/wiki/ISCSI" target="_blank">iSCSI</a></li>
<li>Block Volume Service lets you dynamically provision and manage block storage
volumes</li>
<li>Block Volume uses the Advanced Encryption Standard (AES) algorithm with 256 bit key for encryption</li>
<ul>
<li>Data is encrypted at rest in both volumes and backups</li>
</ul>
<li>You can create, attach, connect, and move volumes, as needed, to meet your storage
and application requirements</li>
<ul>
<li>Once attached and connected to an instance, you can use a volume <u>like a regular hard drive</u></li>
<li>Volumes can also be disconnected and attached to another instance <u>without the loss of data</u></li>
<li>Volumes are only accessible to instances in the same <a href="https://docs.cloud.oracle.com/iaas/Content/General/Concepts/regions.htm?Highlight=Availability%20Domain" target="_blank">Availability Domain</a> (<b>AD</b>) </li>
<ul>
<li>You cannot move a volume between availability domains or regions</li>
<li>However, <a href="https://docs.cloud.oracle.com/iaas/Content/Block/Concepts/blockvolumebackups.htm" target="_blank">block volume backups</a> can be restored as new volumes to any availability domain within the same region they are stored</li>
</ul>
</ul>
</ul>
<li><b><a href="https://docs.cloud.oracle.com/iaas/Content/Object/Concepts/objectstorageoverview.htm" target="_blank">Object Storage Service </a></b></li>
<ul>
<li>See [1] for more details</li>
</ul>
</ul>
</div>
<div>
In this article, we will cover <a href="https://docs.cloud.oracle.com/iaas/Content/Block/Concepts/overview.htm?Highlight=block%20storage">Block Volume Service</a>. But, before we start, we will begin with a related OCI Storage Option―local <a href="https://en.wikipedia.org/wiki/NVM_Express" target="_blank">NVMe SSD</a>.<br />
<br /></div>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhSiP1Vqy9-Jh_VobgGA08xMszVhncUm90JnlSqHV6lnSVmoBuGcwoj8GY1fMKlBpVcMBK9AXu55-4BrGFpTLbuJ3yR7fPpg1ldlRbCd0itcl9RvH3LDKigHyxM08DLzBHMasuPi3Nr2-2a/s1600/OCI_Block_Volume.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="453" data-original-width="1024" height="246" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhSiP1Vqy9-Jh_VobgGA08xMszVhncUm90JnlSqHV6lnSVmoBuGcwoj8GY1fMKlBpVcMBK9AXu55-4BrGFpTLbuJ3yR7fPpg1ldlRbCd0itcl9RvH3LDKigHyxM08DLzBHMasuPi3Nr2-2a/s640/OCI_Block_Volume.jpg" width="560" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 1. </b>OCI Storage </td></tr>
</tbody></table>
<div class="separator" style="clear: both; text-align: center;">
</div>
<div>
<h3>
<br />Local NVMe SSD Storage</h3>
<div>
<br /></div>
OCI provides a variety of instance configurations in both bare metal (<b>BM</b>) and virtual machine (<b>VM</b>) shapes. Each shape varies on multiple dimensions including memory, CPU cores, network bandwidth, and the option of local <a href="https://en.wikipedia.org/wiki/NVM_Express" target="_blank">NVMe SSD</a> storage found in <a href="https://docs.cloud.oracle.com/iaas/Content/Compute/Concepts/computeperformance.htm?Highlight=Dense%20IO%20shapes" target="_blank">Dense IO shapes</a>.</div>
<div>
<span face=""helvetica neue" , , "blinkmacsystemfont" , "segoe ui" , "roboto" , , "ubuntu" , "cantarell" , sans-serif" style="color: #666666;"><br /></span><a href="https://en.wikipedia.org/wiki/NVM_Express" target="_blank">NVMe SSD</a> Devices are locally attached to some instance shapes in OCI. It has the following features:<br />
<ul style="text-align: left;">
<li>It can be used for workloads (e.g., <a href="https://en.wikipedia.org/wiki/Big_data" target="_blank">Big Data</a>, <a href="https://en.wikipedia.org/wiki/Online_transaction_processing" target="_blank">OLTP</a>) requiring high storage performance </li>
<li>Data are persisted during reboot or pause</li>
<li>These devices are not protected </li>
<ul>
<li>Customers are responsible to protect and manage the durability the data on these devices</li>
<li>A protected RAID array is the recommended way to protect against an NVMe device failure. There are three RAID levels that can be used for the majority of workloads:</li>
<ul>
<li>RAID 1</li>
<ul>
<li>Blocks mirrored</li>
</ul>
<li>RAID 10</li>
<ul>
<li>Blocks mirrored and striped</li>
</ul>
<li>RAID 6</li>
<ul>
<li>Blocks striped with dual parity across drives</li>
</ul>
</ul>
</ul>
<li>OCI provides a <a href="https://en.wikipedia.org/wiki/Service-level_agreement" target="_blank">service-level agreement</a> (SLA) for NVMe performance</li>
</ul>
<div>
<br /></div>
<h3>
Block Volume Service</h3>
<br />
A common usage of <a href="https://docs.cloud.oracle.com/iaas/Content/Block/Concepts/overview.htm?Highlight=block%20storage" target="_blank">Block Volume Service</a> is to add storage capacity to an instance. Block volumes provide you <u>persistent and durable storage</u>. All volumes are <u>automatically replicated</u> for you, helping to protect against data loss. Any data will remain intact until you reformat or delete the volume. There are two types of volumes:<br />
<ul>
<li><b>Block volume</b></li>
<ul>
<li>A detachable block storage device for your data storage</li>
</ul>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Block/Concepts/bootvolumes.htm">Boot Volumes</a></li>
<ul>
<li>Detachable system disks for your Compute instances</li>
<li>When you <u>terminate </u>an instance, you <u>can keep the associated boot volume</u> and use it to launch a new instance using a different instance type or shape</li>
</ul>
</ul>
To use a block
storage volume, you need to follow below <u><b><span style="color: red;">four steps</span></b></u>:<br />
<ol style="text-align: left;">
<li><b>Create</b> a block storage volume through the console (see Figure 3) or the API </li>
<li><b>Attach</b> the volume to an instance using a volume attachment (See Figure 2)</li>
<li><b>Connect</b> to the volume from your instance's guest OS using iSCSI </li>
<li><b>Mount</b> the volume and use within your instance</li>
</ol>
</div>
<div>
<br />
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg0z4pFBwLBn8xhMlOOoGgzHwFsfK_Ksm-1E8alWjZAHRWcyFJsuDdhw2FOelWUFt5uDL20lUqWcu6j7lr9l0TtNyUMUPnYSl99_NY5-aLQsgTevKM4hYw83UZ-XO21jo6lCGSH1o9TfeFk/s1600/AttachBV.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="393" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg0z4pFBwLBn8xhMlOOoGgzHwFsfK_Ksm-1E8alWjZAHRWcyFJsuDdhw2FOelWUFt5uDL20lUqWcu6j7lr9l0TtNyUMUPnYSl99_NY5-aLQsgTevKM4hYw83UZ-XO21jo6lCGSH1o9TfeFk/s1600/AttachBV.jpg" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 2. </b>Attach Block Volume</td></tr>
</tbody></table>
<br /></div>
<div>
<h3>
Backup Policy (Options in Step 1)</h3>
<div>
<br /></div>
The OCI Block Volume service provides you with the capability to perform volume backups automatically on a schedule and retain them based on the selected backup policy. Each backup policy has a set <u>backup frequency</u> and <u>retention period</u>. This allows you to adhere to your data compliance and regulatory requirements. See <a href="https://docs.cloud.oracle.com/iaas/Content/Block/Concepts/blockvolumebackups.htm" target="_blank">Overview of Block Volume Backups</a> for more information.</div>
<div>
<br />
When you <a href="https://docs.cloud.oracle.com/iaas/Content/Block/Tasks/creatingavolume.htm" target="_blank">create</a> a new volume on OCI, you can select the appropriate backup policy at that time:</div>
<div>
<ul style="text-align: left;">
<li><b>None</b></li>
<ul>
<li>If your requirements change</li>
<ul>
<li>You can adjust the schedule and retention period by selecting a different backup policy</li>
<li>You can also do <a href="https://docs.cloud.oracle.com/iaas/Content/Block/Tasks/backingupavolume.htm" target="_blank">manual backups</a></li>
</ul>
</ul>
<li><b>Bronze</b> </li>
<ul>
<li><u>Monthly incremental</u> backups</li>
<ul>
<li>Run on the first day of the month. Incremental backups are retained for 12 months</li>
</ul>
<li><u>Yearly full</u> backup</li>
<ul>
<li>Run yearly on January 1st. Full backups are retained for 5 years</li>
</ul>
</ul>
<li><b>Silver</b> </li>
<ul>
<li><u>Weakly incremental</u> backups</li>
<ul>
<li>Run on Sunday. Incremental backups are retained for 4 weeks</li>
</ul>
<li><u>Monthly full</u> backup</li>
<ul>
<li>Run on the first day of the month and are retained for 12 months </li>
</ul>
<li><u>Yearly full</u> backup</li>
<ul>
<li>Run yearly on January 1st. Full backups are retained for 5 years</li>
</ul>
</ul>
<li><b>Gold</b> </li>
<ul>
<li><u>Daily incremental</u> backups</li>
<ul>
<li>Incremental backups are retained for 7 days</li>
</ul>
<li><u>Weakly incremental</u> backups</li>
<ul>
<li>Run on Sunday. Incremental backups are retained for 5 weeks</li>
</ul>
<li><u>Monthly full</u> backup</li>
<ul>
<li>Run on the first day of the month and are retained for 12 months </li>
</ul>
<li><u>Yearly full</u> backup</li>
<ul>
<li>Run yearly on January 1st. Full backups are retained for 5 years</li>
</ul>
</ul>
</ul>
</div>
<div>
<br /></div>
<div>
<h3>
iSCSI vs Paravirtualized (Options in Step 2)</h3>
</div>
<br />
At step 2, you can choose how to attach your block volume in two ways:<br />
<ul style="text-align: left;">
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Block/Concepts/overview.htm#iSCSI">iSCSI</a></li>
<ul>
<li>A TCP/IP-based standard used for communication between a volume and attached instance</li>
<li>Are the only option when connecting block volumes to </li>
<ul>
<li><u>Bare metal instances</u></li>
<li><u>VM instances</u> based on Windows images published prior to February 2018</li>
<li><u>VM instances</u> based on Linux images published prior to December 2017. </li>
</ul>
</ul>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Block/Concepts/overview.htm#Paravirtualized">Paravirtualized</a></li>
<ul>
<li>A virtualized attachment available for VMs</li>
<li>Once you attach a volume using the paravirtualized attachment type, it is ready to use, you do not need to run any additional commands. </li>
<li>However, due to the overhead of virtualization, this reduces the maximum IOPS performance for larger block volumes</li>
</ul>
</ul>
<div>
<div>
Note that you should <u>only attach Linux volumes to Linux instances and Windows volumes to Windows instances</u>.</div>
</div>
<div>
<br /></div>
<h3>
Step 3 and 4</h3>
<div>
<br /></div>
<div>
You connect (step 3) or mount (step 4) block volumes differently based on below considerations:</div>
<div>
<ul style="text-align: left;">
<li><b>Volume Attachment Type</b></li>
<ul>
<li><b>Paravirtualized</b></li>
<ul>
<li>The volumes are connected automatically</li>
</ul>
<ul></ul>
<li><b>iSCSI</b></li>
<ul>
<li>You still need to connect and mount the volume from the instance for the volume to be usable</li>
<ul>
<li>For more information, see <a href="https://docs.cloud.oracle.com/iaas/Content/Block/Concepts/overview.htm#attachtype">Volume Attachment Types</a> and <a href="https://docs.cloud.oracle.com/iaas/Content/Block/Tasks/connectingtoavolume.htm">Connecting to a Volume</a></li>
</ul>
</ul>
</ul>
<li><b>OS Type</b></li>
<ul>
<li><b>Linux-Based Instances</b></li>
<ul>
<li>On Linux operating systems, the order in which volumes are attached is non-deterministic, so it can change with each reboot</li>
<ul>
<li>If you refer to a volume using the device name, such as /dev/sdb, and you have more than one non-root volume, you can't guarantee that the volume you intend to mount for a specific device name will be the volume mounted</li>
</ul>
<li>If you want to <u>mount</u> automatically volumes on instance boot, you need to set some specific options in the /etc/fstab file, or the instance may fail to launch. This applies to both iSCSI and paravirtualized attachment types. </li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Block/References/consistentdevicepaths.htm" target="_blank">Consistent Device Path</a></li>
<ul>
<li>For volumes using consistent device paths, see <a href="https://docs.cloud.oracle.com/iaas/Content/Block/References/fstaboptionsconsistentdevicepaths.htm">/etc/fstab Options for Block Volumes Using Consistent Device Paths</a></li>
<li>For all other volumes, see <a href="https://docs.cloud.oracle.com/iaas/Content/Block/References/fstaboptions.htm">/etc/fstab Options</a></li>
</ul>
</ul>
<li><b>Windows-Based Instances</b></li>
<ul>
<li>Read <a href="http://connecting%20to%20a%20volume%20on%20a%20windows%20instance/" target="_blank">Connecting to a Volume on a Windows Instance</a> for more information</li>
</ul>
</ul>
</ul>
</div>
<div><br />
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEidU4lg0alIqmFbxRP1-T5geQmkeZXxOyca448W-YK0QfFR9ri3ifPdh1wYaZZB3dRt4Dm3Ci5wDixsS9qycKHxjFSEO3YNzv5gzlXNy3dRlB1tQMx1DwFcEC5PD3PP3IwWD6rc5-fpOIXv/s1600/BV1.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="853" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEidU4lg0alIqmFbxRP1-T5geQmkeZXxOyca448W-YK0QfFR9ri3ifPdh1wYaZZB3dRt4Dm3Ci5wDixsS9qycKHxjFSEO3YNzv5gzlXNy3dRlB1tQMx1DwFcEC5PD3PP3IwWD6rc5-fpOIXv/s1600/BV1.jpg" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><span><span style="font-weight: bold;">Figure 3. </span>Create Block Volume<br /><div style="text-align: left;"><span style="font-size: 12.8px; font-weight: 700;"><br /></span></div><div style="text-align: left;"><span style="font-size: 12.8px; font-weight: 700;"><br /></span></div></span></td></tr>
</tbody></table>
<div>
<h3>References</h3><ol><li><a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-object-storage-basics.html" target="_blank">OCI―Knowing Object Storage Basics</a></li><li><a href="https://docs.cloud.oracle.com/iaas/Content/Compute/References/nvmedeviceinformation.htm" target="_blank">Protecting Data on NVMe Devices</a></li><li><a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-identity-and-access.html" target="_blank">OCI―Knowing Identity and Access Management Basics</a> (XML and More)</li><li><a href="https://docs.cloud.oracle.com/iaas/Content/Block/Tasks/backingupavolume.htm" target="_blank">Backing up a volume</a> (OCI)</li><li><a href="https://docs.cloud.oracle.com/iaas/Content/Block/Concepts/blockvolumebackups.htm" target="_blank">Overview of Block Volume Backups</a> (OCI)</li><ul><li>Backups are encrypted and stored in the <a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-object-storage-basics.html" target="_blank">Object Storage Service</a>, and can be restored as new volumes to any Availability Domain within the same region</li></ul><li><a href="https://docs.cloud.oracle.com/iaas/Content/Block/References/consistentdevicepaths.htm">Connecting to Volumes With Consistent Device Paths</a> (OCI)</li><li><a href="https://docs.cloud.oracle.com/iaas/Content/Block/Tasks/cloningavolume.htm" target="_blank">Cloning a Volume</a> (OCI)</li><ul><li>Cloning enables you to make a copy of an existing block volume without needing to go through the backup and restore process</li></ul><li><a href="https://docs.cloud.oracle.com/iaas/Content/Block/Concepts/blockvolumeperformance.htm?Highlight=60%20IOPS" target="_blank">Block Volume Performance</a> (OCI)</li><li><a href="https://docs.cloud.oracle.com/iaas/Content/Block/Concepts/volumegroups.htm" target="_blank">Volume Groups</a> (OCI)</li><li><a href="http://searchstorage.techtarget.com/definition/iSCSI">What is iSCSI?</a></li><li><a href="https://docs.oracle.com/cd/E52668_01/E54669/html/ol7-s15-storage.html">Oracle Linux Administrator's Guide for Release 7 - About iSCSI Storage</a></li><li><a href="https://docs.oracle.com/cd/E37670_01/E41138/html/ch18s07.html">Oracle Linux Administrator's Guide for Release 6 - About iSCSI Storage</a></li><li><a href="https://docs.oracle.com/cd/E23824_01/html/821-1459/fpjwy.html">Troubleshooting iSCSI Configuration Problems</a></li><li><a href="https://eucalyptus.atlassian.net/wiki/display/STOR/iscsiadm+basics">iscsiadm Basics</a></li></ol></div>
</div>
</div>
Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com0tag:blogger.com,1999:blog-748094882401183761.post-71876222568026737902019-01-13T12:46:00.001-06:002021-12-16T11:27:52.714-06:00OCI―Knowing Object Storage Basics<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;"><iframe width="560" height="315" src="https://www.youtube.com/embed/OOuztXh5bd0" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe></div>
<br />
<div style="text-align: center;"><span style="font-family: inherit;"><b>Video 1.</b> OCI Object Storage (YouTube <a href="https://www.youtube.com/watch?v=OOuztXh5bd0" target="_blank">link</a>)</span></div>
<div style="text-align: center;">
<br /></div>
<br />
<a href="https://docs.cloud.oracle.com/iaas/Content/Object/Concepts/objectstorageoverview.htm" target="_blank">Object Storage</a> (in <a href="https://docs.cloud.oracle.com/iaas/Content/GSG/Concepts/concepts.htm" target="_blank">Oracle Cloud Infrastructure</a> or <b>OCI</b>) is where data is handled as an object, also known as <u>unstructured data</u>. The main differences between object storage and traditional storage (also known as block storage), are listed as follows:<br />
<ul style="text-align: left;">
<li>Stored data contains customized <b>metadata</b></li>
<li>Data is <b>indexed</b>, allowing for much faster search results</li>
<li>Data can be <b>located by</b> using <b>pointers </b>instead of finding its location based on tracks and sectors on the hard disk (that is, the standard file system that we have used for many years).</li>
</ul>
<br />
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh9CnsM0C3iRGED2hWRrlpYL46B1NXB_RZ0TG65SoFbBaLjAUhKepU1hnbk-7vIh_l_piXHFIARg46M5KFs8zAkVW7iMrYjA5any3H-96VdbcnofAS81EGV213X2S_jrf3gpfNdhKQk9UH0/s1600/CreateBucket.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="506" data-original-width="1114" height="254" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh9CnsM0C3iRGED2hWRrlpYL46B1NXB_RZ0TG65SoFbBaLjAUhKepU1hnbk-7vIh_l_piXHFIARg46M5KFs8zAkVW7iMrYjA5any3H-96VdbcnofAS81EGV213X2S_jrf3gpfNdhKQk9UH0/s640/CreateBucket.jpg" width="560" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 1. Storage tier: Standard vs Archive</b></td></tr>
</tbody></table>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhhOHonn8IRkm4W_A1w8-d24YQSqaZ0n7Ms1Rx_uS9pOWmuaeyKse2DcKY07YIIYp-npv4utcMHDOIFGuVbD9mozewX6mJ-U2ktJBEKYugaLo_AyK6Qkp_aG-KFoIAxs2X6audatqIkXdLJ/s1600/OCI_Storage_services.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="252" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhhOHonn8IRkm4W_A1w8-d24YQSqaZ0n7Ms1Rx_uS9pOWmuaeyKse2DcKY07YIIYp-npv4utcMHDOIFGuVbD9mozewX6mJ-U2ktJBEKYugaLo_AyK6Qkp_aG-KFoIAxs2X6audatqIkXdLJ/s1600/OCI_Storage_services.jpg" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 2. Object Storage (Standard vs Archive)</b></td></tr>
</tbody></table>
<br />
<h3>
Standard vs. Archive</h3>
<br />
Object Storage is a "public" OCI service and a regional service (i.e., not tied to any specific compute instance).<br />
<br />
As shown in Figure 1 (click to enlarge), you can create new bucket under a <a href="https://docs.cloud.oracle.com/iaas/Content/Identity/Tasks/managingcompartments.htm?Highlight=compartment" target="_blank">compartment</a> (i.e., "Training") and in a <a href="https://docs.cloud.oracle.com/iaas/Content/General/Concepts/regions.htm?Highlight=region" target="_blank">region</a> (i.e., "us-ashburn-1"). OCI offers two distinct storage tiers for you to store unstructured data:<br />
<br />
<ul style="text-align: left;">
<li><b>Standard</b> (i.e., <a href="https://docs.cloud.oracle.com/iaas/Content/Object/Concepts/objectstorageoverview.htm" target="_blank">Object Storage</a>)</li>
<ul>
<li>Choose it for data to which you need fast, immediate, and frequent access</li>
</ul>
<li><b>Archive </b>(i.e., <a href="https://docs.cloud.oracle.com/iaas/Content/Archive/Concepts/archivestorageoverview.htm" target="_blank">Archive Storage</a>)</li>
<ul>
<li>Choose it for data to which you seldom or rarely access, but that must be retained and preserved for long periods of time</li>
<li>More cost-effective than Object Storage</li>
</ul>
</ul>
<br />
<br />
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiDN1pQbTPpvtUAUak5PbNePmxBXSA8J6q8U1FvNUJV-KZkAmrAlY8CIjrvajj1PbZ2Tj-Bk_EzN-jfFFtaSEdLAfBEsISoj8GyyjL56bGcrx9G8aJFlwRnpbXzDjW3n9xiHgtzcVIRvrQW/s1600/ServiceGateway.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="603" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiDN1pQbTPpvtUAUak5PbNePmxBXSA8J6q8U1FvNUJV-KZkAmrAlY8CIjrvajj1PbZ2Tj-Bk_EzN-jfFFtaSEdLAfBEsISoj8GyyjL56bGcrx9G8aJFlwRnpbXzDjW3n9xiHgtzcVIRvrQW/s1600/ServiceGateway.jpg" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 3. Storage Object provides both public access and private access</b></td></tr>
</tbody></table>
<h3>
</h3>
<h3>
</h3>
<h3>
Public vs Private Access</h3>
<div>
<br /></div>
<div>
Object Storage supports:</div>
<div>
<ul style="text-align: left;">
<li>Public Access from Internet</li>
<ul>
<li>You can access data from anywhere inside or outside the context of the OCI, as long you have Internet connectivity and can access one of the <a href="https://docs.cloud.oracle.com/iaas/Content/API/Concepts/usingapi.htm">Object Storage endpoints</a>.</li>
</ul>
<li>Private Access from VCN using <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/servicegateway.htm?Highlight=service%20gateway" target="_blank">Service Gateway</a></li>
<ul>
<li>Any traffic from VCN that is destined for one of the supported OCI public services uses the instance's private IP address for routing, travels over OCI network fabric, and never traverses the Internet.</li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/servicegateway.htm?Highlight=service%20gateway" target="_blank">Service gateway</a> can be used, for example, to back up private DB systems in VCN to public Object Storage, which lets resources in VCN access public Object Storage service, but without using an Internet or NAT gateway.</li>
</ul>
</ul>
<div>
<br /></div>
</div>
<h3>
</h3>
<h3>
Managing Object Storage</h3>
<br />
Object Storage offers multiple <a href="https://docs.cloud.oracle.com/iaas/Content/Object/Concepts/objectstorageoverview.htm#WaysToAccess">management interfaces</a> that let you easily manage storage at scale. The size of the object determines the appropriate management interface to use to upload objects to OCI Object Storage:<br />
<ul style="text-align: left;">
<li>You can use the Console to upload objects up to 2 GiB in size.</li>
<li>You can use the <a href="https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/cliusing.htm?Highlight=jmespath" target="_blank">CLI</a> or API to upload objects up to 10 TiB in size.</li>
<li>You can use the <a href="https://docs.cloud.oracle.com/iaas/Content/Object/Tasks/usingmultipartuploads.htm" target="_blank">multipart upload API</a> to upload objects larger than 100 MiB (recommended).</li>
</ul>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj0wx1_05I0kj_sUL-Ip9e8T16atl0iSjrY4dq9Rs_di6Nl4nem6lHfiYTkxv8V5lUhRrxMtORCKyZlJazNrwoOKHneN35aOuNkwV9bTWvk-zwnQeD1usG9z-rTVLf-ciA8OgN4KxkMAU0O/s1600/bucket_object.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="231" data-original-width="438" height="210" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj0wx1_05I0kj_sUL-Ip9e8T16atl0iSjrY4dq9Rs_di6Nl4nem6lHfiYTkxv8V5lUhRrxMtORCKyZlJazNrwoOKHneN35aOuNkwV9bTWvk-zwnQeD1usG9z-rTVLf-ciA8OgN4KxkMAU0O/s400/bucket_object.jpg" width="400" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 4. Object Storage Elements</b></td></tr>
</tbody></table>
<div>
<br /></div>
<div>
<h3>
Key Concepts</h3>
</div>
<div>
<br /></div>
<div>
Before we cover the Object Identifiers, you need to know below key concepts:</div>
<div style="text-align: left;">
<ul style="text-align: left;">
<li><b>Compartment</b></li>
<ul>
<li>Is a collection of related resources that can be accessed only by certain groups</li>
</ul>
<li><b>Bucket</b></li>
<ul>
<li>Is a logical container for
storing objects</li>
<li>A bucket is
associated with a single
compartment that has policies that determine what actions a user can perform on a bucket and on all objects in the bucket</li>
</ul>
<li><b>Object</b></li>
<ul>
<li>Is any type of data,
regardless of content type</li>
<li>Is comprised of the object itself
and metadata about the object</li>
</ul>
<li><b>Namespace</b></li>
<ul>
<li>Each OCI tenant is assigned one unique and uneditable Object Storage namespace that is global (spanning all regions and compartments)</li>
<ul>
<li>Is a system-generated string assigned during account creation. </li>
<li>Note that for some older tenancies, the namespace string may be the tenancy name in all lower-case letters</li>
</ul>
<li>Serves as a top-level container for all buckets and objects and allows you to control bucket naming within your tenancy</li>
<ul>
<li>While bucket names must be unique within your tenancy, your tenancy's bucket names can duplicate the bucket names chosen by other tenants. </li>
</ul>
</ul>
</ul>
</div>
<div>
<br />
<br />
<br />
<br />
<br />
<dt style="background-color: white; color: #666666; font-family: "Helvetica Neue", -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, Oxygen-Sans, Ubuntu, Cantarell, sans-serif; font-size: 16px; font-weight: bold; margin: 2rem 0px 0.5rem; text-transform: uppercase;"><a href="https://www.blogger.com/null" name="object" style="color: #1e87f0; cursor: pointer;"></a></dt>
</div>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgY-BnLh5t9M0eupNURf_UiOPqFILVUJJGUZkHM_86UXADNmJIDrod3nJ9eCR0Z38ZPRRi7fpSLDHBbyWRnoiuBrPP9Hwx8nzrM-8QsllVii2LhWUlxyl86vXRSw2bghjZpKMjOF9SUU2y8/s1600/ObjectIdentifier.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="367" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgY-BnLh5t9M0eupNURf_UiOPqFILVUJJGUZkHM_86UXADNmJIDrod3nJ9eCR0Z38ZPRRi7fpSLDHBbyWRnoiuBrPP9Hwx8nzrM-8QsllVii2LhWUlxyl86vXRSw2bghjZpKMjOF9SUU2y8/s1600/ObjectIdentifier.jpg" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 5. Object Details</b></td></tr>
</tbody></table>
<div>
<br /></div>
<h3>
Object Identifier―URI</h3>
<div>
<br /></div>
<div>
Data in Object Storage are managed as objects using a RESTful API built on standard HTTP verbs (e.g., GET, PUT, DELETE).</div>
<div>
<br /></div>
Unlike other resources, objects do not have <a href="https://docs.cloud.oracle.com/iaas/Content/General/Concepts/identifiers.htm?Highlight=ocid" target="_blank">Oracle Cloud Identifiers</a> (<b>OCIDs</b>). Instead, users define an <u>object name</u> when they upload an object. Then Object Storage prepends the Object Storage <u>namespace</u> string and <u>bucket name</u> to the object name:<br />
<div>
<pre style="background: rgb(255, 255, 255); border-radius: 3px; border: 1px solid rgb(196, 206, 215); color: #666666; font-family: SFMono-Regular, Consolas, "Liberation Mono", Menlo, Courier, monospace; font-size: 0.875rem; font-stretch: normal; font-variant-east-asian: normal; font-variant-numeric: normal; line-height: 1.5; margin-bottom: 20px; margin-top: 20px; overflow: auto; padding: 10px; tab-size: 4;"><code style="font-family: SFMono-Regular, Consolas, "Liberation Mono", Menlo, Courier, monospace;">/n/<var style="color: #cc0000;"><object_storage_namespace></var>/b/<var style="color: #cc0000;"><<mark style="background: rgb(249, 249, 143); color: inherit;">bucket</mark>></var>/o/<var style="color: #cc0000;"><object_name></object_name></var></code></pre>
<div style="margin-bottom: 20px; margin-top: 20px;">
The object name is everything after the<span face=""helvetica neue" , , "blinkmacsystemfont" , "segoe ui" , "roboto" , , "ubuntu" , "cantarell" , sans-serif" style="color: #666666;"><span style="background-color: white;"> </span></span><code style="background: rgb(248, 248, 248); color: #666666; font-family: SFMono-Regular, Consolas, "Liberation Mono", Menlo, Courier, monospace; font-size: 0.875rem; padding: 2px 6px;">/o/</code>.</div>
<div style="margin-bottom: 20px; margin-top: 20px;">
<span style="background-attachment: initial; background-clip: initial; background-image: initial; background-origin: initial; background-position: initial; background-repeat: initial; background-size: initial; padding: 2px 6px;">For example: </span><code><span style="color: #666666; font-family: , "consolas" , "liberation mono" , "menlo" , "courier" , monospace;"><span style="background: rgb(248, 248, 248); font-size: 0.875rem; padding: 2px 6px;">/n/ansh8lvru1zp/b/accessories/o/backpack_75.jpg</span></span></code></div>
<div>
<div>
Within an Object Storage namespace, buckets and objects <u>exist in a flat hierarchy</u>, but you can simulate a directory structure using a prefix string that includes the forward slash (/) to add hierarchy to an object name. Doing so lets you list one directory at a time, which is helpful when navigating a large set of objects.<br />
<br />
For example:<br />
<div style="background-color: white; color: #666666; font-family: "Helvetica Neue", -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, Oxygen-Sans, Ubuntu, Cantarell, sans-serif; font-size: 16px; margin-bottom: 20px; margin-top: 20px;">
<code style="background: rgb(248, 248, 248); font-family: SFMono-Regular, Consolas, "Liberation Mono", Menlo, Courier, monospace; font-size: 0.875rem; padding: 2px 6px;">/n/ansh8tvru7zp/b/event_photos/o/<var style="color: #cc0000;">marathon</var><span style="color: orangered;">/</span>finish_line.jpg</code></div>
<div style="background-color: white; color: #666666; font-family: "Helvetica Neue", -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, Oxygen-Sans, Ubuntu, Cantarell, sans-serif; font-size: 16px; margin-bottom: 20px; margin-top: 20px;">
<code style="background: rgb(248, 248, 248); font-family: SFMono-Regular, Consolas, "Liberation Mono", Menlo, Courier, monospace; font-size: 0.875rem; padding: 2px 6px;">/n/ansh8tvru7zp/b/event_photos/o/<var style="color: #cc0000;">marathon</var><span style="color: orangered;">/</span><var style="color: #cc0000;">participants</var><span style="color: orangered;">/</span>p_21.jpg</code></div>
If you named your objects so that they exist in Object Storage as a hierarchy, you can use the <a href="https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/cliusing.htm?Highlight=jmespath" target="_blank">CLI</a> to perform bulk downloads and bulk deletes of all objects at a specified level of the hierarchy, without affecting objects in levels above or below. In the example above, you can use the <a href="https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/cliusing.htm?Highlight=jmespath" target="_blank">CLI</a> to download or delete all objects at the marathon/ level without downloading or deleting objects at the marathon/participants/ sublevel.When naming objects, you can also use prefix strings without a delimiter so that certain bulk operations can be performed in the <a href="https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/cliusing.htm?Highlight=jmespath" target="_blank">CLI</a> by matching on the prefix portion of the object name. For example, in the object names below, the string gloves_27_ can serve as a prefix for matching purposes when performing bulk downloads or deletions:<br />
<pre style="background: rgb(255, 255, 255); border-radius: 3px; border: 1px solid rgb(196, 206, 215); color: #666666; font-family: SFMono-Regular, Consolas, "Liberation Mono", Menlo, Courier, monospace; font-size: 0.875rem; font-stretch: normal; font-variant-east-asian: normal; font-variant-numeric: normal; line-height: 1.5; margin-bottom: 20px; margin-top: 20px; overflow: auto; padding: 10px; tab-size: 4;">/n/ansh8tvru7zp/b/apparel/o/<span style="color: orangered;">gloves_27_</span>dark_green.jpg
/n/ansh8tvru7zp/b/apparel/o/<span style="color: orangered;">gloves_27_</span>light_blue.jpg </pre>
When you perform bulk uploads with the <a href="https://docs.cloud.oracle.com/iaas/Content/API/SDKDocs/cliusing.htm?Highlight=jmespath" target="_blank">CLI</a>, you can prepend a prefix string to the names of the files you are uploading.</div>
<div>
<br /></div>
<div>
<h3>
Object Storage Features</h3>
<div>
<br /></div>
<div>
Following are some salient features of OCI <a href="https://docs.cloud.oracle.com/iaas/Content/Object/Concepts/objectstorageoverview.htm" target="_blank">Object Storage</a>: </div>
<div>
<ul style="text-align: left;">
<li><b>Strong Consistency</b></li>
<ul>
<li>When a read request is made, the Object Storage Service always serves the most recent copy of the data that was written to the system</li>
</ul>
<li><b>Durability</b></li>
<ul>
<li>Data is stored redundantly across multiple storage servers across multiple Availability Domains</li>
<li>Data integrity is actively monitored using checksums and corrupt data is detected and auto repaired. </li>
<li>Any loss of data redundancy is actively managed by recreating a copy of the data from the redundant copy. </li>
</ul>
<li><b>Performance</b></li>
<ul>
<li>The Compute Service and the Object Storage Service are co-located on the same network. </li>
</ul>
<li><b>Custom Metadata</b></li>
<ul>
<li>You can define your own extensive metadata as key-value pairs for any purpose. </li>
<ul>
<li>For example, you can create descriptive tags for objects, retrieve those tags, and sort through the data.</li>
</ul>
</ul>
<li><b>Hadoop Support</b></li>
<ul>
<li>You can use the Object Storage Service as the primary data repository for big data. </li>
<li>The HDFS connector provides connectivity to various big data analytic engines. </li>
<li>This connectivity enables the analytics engines to work directly with data stored in the Object Storage Service</li>
</ul>
<li><b>Encryption</b></li>
<ul>
<li>The Object Storage Service employs 256-bit Advanced Encryption Standard (AES-256) to encrypt object data on the server. Each object is encrypted with its own key. Object keys are encrypted with a master encryption key that is frequently rotated. Encryption is enabled by default and cannot be turned off.</li>
</ul>
</ul>
</div>
<div>
OCI Object Storage also supports the following advanced operations:</div>
<div>
<div>
<ul style="text-align: left;">
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Object/Tasks/copyingobjects.htm?Highlight=Cross-region%20copy" target="_blank">Cross-region copy</a></li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Object/Tasks/usingpreauthenticatedrequests.htm" target="_blank">Pre-authenticated requests</a></li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Object/Tasks/usinglifecyclepolicies.htm" target="_blank">Object lifecycle management</a></li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Object/Tasks/usingmultipartuploads.htm" target="_blank">Multipart uploads</a></li>
</ul>
</div>
</div>
<div style="-en-clipboard: true;">
<div class="separator" style="clear: both;">
<br /></div>
<h3>
References</h3>
<ol>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Object/Concepts/objectstorageoverview.htm" target="_blank">Overview of Object Storage</a> (OCI)</li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/mig-onprembackup.htm?Highlight=Oracle%20Database%20Backup%20Cloud%20Service" target="_blank">Migrating an On-Premises Database to Oracle Cloud Infrastructure by Creating a Backup in the Cloud</a> (OCI)</li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Database/Tasks/backingupOS.htm?Highlight=Oracle%20Database%20Backup%20Cloud%20Service" target="_blank">Backing Up to Oracle CloudInfrastructure Object Storage</a> (OCI)</li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/servicegateway.htm?Highlight=service%20gateway" target="_blank">Access to Object Storage: Service Gateway</a> (OCI)</li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Identity/Reference/objectstoragepolicyreference.htm">Details for Object Storage</a> (OCI)</li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Object/Tasks/usingmultipartuploads.htm">Using Multipart Uploads</a> (OCI)</li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Identity/Reference/objectstoragepolicyreference.htm">Archive Storage</a> (OCI)</li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Identity/Reference/objectstoragepolicyreference.htm">Data Transfer</a> (OCI)</li>
</ol>
<br /></div>
</div>
</div>
</div>
</div>
Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com0tag:blogger.com,1999:blog-748094882401183761.post-52498015582251768592019-01-12T11:35:00.006-06:002021-12-16T12:21:47.093-06:00OCI―Knowing Virtual Cloud Network Basics<div dir="ltr" style="text-align: left;" trbidi="on">
An Oracle Cloud Infrastructure (OCI) <a href="https://cloud.oracle.com/iaas/whitepapers/vcn-deployment-guide.pdf">Virtual Cloud Network</a> (<b>VCN</b>) is a virtual version of a traditional network on which your <a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-compute-service-basics.html" target="_blank">instances</a> run.<br />
<div>
<br />
<div class="separator" style="clear: both; text-align: center;"><iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen="" frameborder="0" height="315" src="https://www.youtube.com/embed/NuWaF0P-Ock" title="YouTube video player" width="560"></iframe></div>
<div style="text-align: center;">
<span><b>Video 1. </b>OCI Level 100 - Virtual Cloud Network (YouTube <a href="https://www.youtube.com/watch?v=NuWaF0P-Ock&list=PLKCk3OyNwIzvHm2E-cGrmoMes-VwanT3P" target="_blank">link</a>)</span></div><div style="text-align: center;"><span><br /></span></div>
</div>
<h3>
Key Features of VCN</h3>
<div>
<br />
<div style="-en-clipboard: true;">
<a href="https://cloud.oracle.com/iaas/whitepapers/vcn-deployment-guide.pdf">Virtual Cloud Network</a> <span style="background-color: #fcff01; color: #800180;">resides within a single <a href="https://docs.cloud.oracle.com/iaas/Content/General/Concepts/regions.htm?Highlight=availability%20domain" target="_blank">region</a> but can cross multiple <a href="https://docs.cloud.oracle.com/iaas/Content/General/Concepts/regions.htm?Highlight=availability%20domain" target="_blank">Availability Domains</a></span> and it has the following key features:</div>
<ul style="text-align: left;">
<li>Includes <b><span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">subnets</span>, <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">route tables</span>, <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">security lists</span></b>, and <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;"><b>gateways</b></span></li>
<li>Covers a single, contiguous <span style="font-weight: bold;">IPv4 <a href="https://en.wikipedia.org/wiki/Classless_Inter-Domain_Routing#CIDR_notation" target="_blank">CIDR</a> block</span> of your choice</li>
<li>Supports either private IP address ranges or a publicly routable range</li>
<ul>
<li>Oracle recommends using one of the private IP address ranges in <a href="https://tools.ietf.org/html/rfc1918" target="_blank">RFC 1918</a> (10.0.0.0/8, 172.16/12, and 192.168/16) for <span style="font-weight: bold;">VCN address space</span>. However, you can use a publicly routable range</li>
</ul>
<li>Allows VCN size range to be from /16 to /30</li>
<ul>
<li>VCN reserves the first two IP addresses and the last one in each subnet's CIDR</li>
</ul>
</ul><div>To <span style="background-color: #fcff01; color: #800180;">create a VCN </span>refer to section "<b>Task1: Set up the VCN and Subnet</b>" in the document <a href="https://docs.cloud.oracle.com/en-us/iaas/Content/Network/Tasks/scenarioc.htm">OCI VCN with Public and Private Subnet</a>. To peer your on-premise network with OCI VCN, you must whitelist for the public endpoint. Refer to this <a href="https://docs.oracle.com/en-us/iaas/Content/Network/Concepts/connectivityonprem.htm" target="_blank">document</a> and peer using either <a href="https://docs.oracle.com/en/solutions/connect-onprem-vpn/index.html" target="_blank">VPN Connect</a> or <a href="https://docs.oracle.com/en-us/iaas/Content/Network/Concepts/fastconnectoverview.htm" target="_blank">FastConnect</a>.</div><div><br /></div>
<div>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg63mJfNMBkbNx4JgrRZqISkunNtMsmpH93wwBVz7b1sFAGFEabitMQdPLRgi0XqY_5v8XsOuuS2pcC7fo0cwDroYul_QUz574SSNDdIv0qpwcBx7zg1Ig19uNRdbDZ-gTManSSyjHsZZ1n/s1600/VCN_default_components.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="343" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg63mJfNMBkbNx4JgrRZqISkunNtMsmpH93wwBVz7b1sFAGFEabitMQdPLRgi0XqY_5v8XsOuuS2pcC7fo0cwDroYul_QUz574SSNDdIv0qpwcBx7zg1Ig19uNRdbDZ-gTManSSyjHsZZ1n/s1600/VCN_default_components.jpg" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 1. Overview of VCN Key Components</b></td></tr>
</tbody></table>
<br /></div>
<h3>
<b>Default VCN Components</b></h3>
<div>
<b><br /></b></div>
<div>
Your VCN automatically comes with
some default components:</div>
<div>
<ul style="text-align: left;">
<li>Default <b>route table</b>, with no rules</li>
<li>Default <b>security list</b>, with default rules</li>
<li>Default set of <b>DHCP options</b>, with default values</li>
</ul>
</div>
<div>
You can’t delete these default
components; however, you can change
their contents (for example: individual
route rules). And you can create more
of each kind of component in your
VCN (for example: additional
route tables). </div>
<div>
<br /></div>
<div>
<h3>
<b>Subnets</b></h3>
</div>
<div style="text-align: left;">
<br /></div>
<div style="text-align: left;">
Each VCN network is subdivided into <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingVCNs.htm?Highlight=subnets" target="_blank">subnets</a>, and each <b>subnet is contained within a single Availability Domain</b>. But, you can have more than one subnet in an AD for a given VCN.<br />
<br />
Each subnet has the following features:<br />
<ul style="text-align: left;">
<li>It acts as a unit of configuration</li>
<ul>
<li>All instances in a given subnet use the same route table, security lists, and DHCP options</li>
<li>Instances draw their internal IP address and network configuration from their subnet</li>
<li>Subnets can have one route table and up to 5 security lists associated with it</li>
</ul>
<li>It has a contiguous range of IPs</li>
<ul>
<li>Subnet IP ranges may not overlap</li>
<li>IP ranges are described in <a href="https://en.wikipedia.org/wiki/Classless_Inter-Domain_Routing#CIDR_notation" target="_blank">CIDR</a> notation</li>
</ul>
<li>It contains <span style="font-weight: bold;"><a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingVNICs.htm?Highlight=vnics" target="_blank">virtual network interface cards</a></span> (<b>VNICs</b>), which attach to instances</li>
<ul>
<li>You can add secondary VNICs to an existing instance and remove them as you like. </li>
<li>All the VNICs must be in subnets in the same availability domain as the instance.</li>
</ul>
<li>It can be designated as either <b>Public </b>or <b>Private</b></li>
<ul>
<li>Private subnet doesn't have access to Internet</li>
</ul>
</ul>
<b>
</b>
<br />
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhgx6KcuWrNMAKfDzwm_ouEK733WM7eAGIJXEgZL0QvQRLXBfvP_dM7An4ZCE2DfYhLjd05-f78iSlSV-LbTXH0XjbPyVZf8StAKpLXfCdjTlMnPW-84bfwAvZ_mlp5u1FYwPEpJsSKEAl5/s1600/DRG_IGW.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="350" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhgx6KcuWrNMAKfDzwm_ouEK733WM7eAGIJXEgZL0QvQRLXBfvP_dM7An4ZCE2DfYhLjd05-f78iSlSV-LbTXH0XjbPyVZf8StAKpLXfCdjTlMnPW-84bfwAvZ_mlp5u1FYwPEpJsSKEAl5/s1600/DRG_IGW.jpg" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 2. Internet Gateway (IGW) and Dynamic Routing Gateway (DRG)</b><br />
<b><br /></b></td></tr>
</tbody></table>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjUvAVbkCON-zrjWE40LVbYHrJSgSqDRI-EBN7YtS6YY9k_Dhn97kzS45YL9XmjMz_59WYOCvGpd6dQhmErzI5p9Od-GPPNCBK1I0ozO_r_PY7rD2C8M_HdF9lNXk3WlgH_KZaRbjcclral/s1600/IPsec_VPN.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="293" data-original-width="720" height="228" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjUvAVbkCON-zrjWE40LVbYHrJSgSqDRI-EBN7YtS6YY9k_Dhn97kzS45YL9XmjMz_59WYOCvGpd6dQhmErzI5p9Od-GPPNCBK1I0ozO_r_PY7rD2C8M_HdF9lNXk3WlgH_KZaRbjcclral/s640/IPsec_VPN.jpg" width="560" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 3. <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingIPsec.htm?Highlight=IPSec%20VPN" target="_blank">IPSec VPN</a> Overview</b></td></tr>
</tbody></table>
<table align="center" cellpadding="0" cellspacing="0" class="tr-caption-container" style="margin-left: auto; margin-right: auto; text-align: center;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjBt685-91iwKvXugVqcfxp6y04fLDlxb88gWyoI9USdslffdQ9diJi_xwiduWe3Vb6H9WnIfU1-jUFVlajsDq5pJLMwhO-cEga0f7aRpguuFds3G1CCJRrjhr6wYlORGLgzZYjPya-SQ5B/s1600/OCI_VPN_FastConnect.jpg" style="margin-left: auto; margin-right: auto;"><img border="0" data-original-height="240" data-original-width="560" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjBt685-91iwKvXugVqcfxp6y04fLDlxb88gWyoI9USdslffdQ9diJi_xwiduWe3Vb6H9WnIfU1-jUFVlajsDq5pJLMwhO-cEga0f7aRpguuFds3G1CCJRrjhr6wYlORGLgzZYjPya-SQ5B/s1600/OCI_VPN_FastConnect.jpg" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Figure 4. IPSec VPN vs FastConnect</b></td></tr>
</tbody></table>
<h3>
<b><br /><br />Gateways</b></h3>
</div>
<div>
<br /></div>
<div>
Read below article for more information:<br />
<blockquote class="tr_bq">
<a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-gateway-basics.html" target="_blank">OCI―Knowing Gateway Basics</a></blockquote>
</div>
<div>
<br /></div>
<h3>
Security List</h3>
<div>
<br /></div>
When you create a subnet, you may optionally specify one or more <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Concepts/securitylists.htm">security lists</a> for the subnet to use (up to five). You can <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingVCNs.htm#edit_subnet">change which security list the subnet uses</a> at any time. </div>
<div>
<br /></div>
<div>
Security list is a common set of firewall rules associated with a subnet and applied to all instances launched inside the subnet. Each security list has the following features:</div>
<div>
<div>
<ul style="text-align: left;">
<li>Provides ingress and
egress rules </li>
<ul>
<li>Which specify the types of
traffic allowed in and out of the
instances</li>
</ul>
<li>Rules can be either <b>stateful</b> (default) or <b>stateless</b></li>
<ul>
<li><b>Stateful security lists</b></li>
<ul>
<li>When an instance receives traffic matching the stateful ingress rule, the response is <u>tracked</u> and automatically allowed regardless of any egress rules</li>
<li>Similarly for sending traffic from the host.</li>
</ul>
<li><b>Stateless security lists</b></li>
<ul>
<li>Response traffic is not automatically allowed</li>
<ul>
<li>To allow the response traffic for a stateless ingress rule, you must create a corresponding stateless egress rule</li>
</ul>
<li>Are better for scenarios with large numbers of connections</li>
</ul>
</ul>
</ul>
</div>
<div>
<b><u>Default Security List</u></b></div>
<div>
<br /></div>
<div>
If you don't specify any security list for a subnet, the subnet uses the VCN's default security list which has the following features:</div>
<div>
<ul style="text-align: left;">
<li>Allows TCP traffic on destination port 22 (SSH) from source 0.0.0.0/0 and any source port</li>
<ul>
<li>Makes it easy for you to create a new cloud network and public
subnet, launch a Linux instance, and then immediately connect through SSH to that instance
without needing to write any security list rules yourself</li>
</ul>
<li>Allows ICMP traffic type 3 code 4 from
source 0.0.0.0/0 and any source port</li>
<ul>
<li>Makes it possible to do <a href="https://en.wikipedia.org/wiki/Path_MTU_Discovery" target="_blank">Path MTU Discovery</a> if you're using jumbo frames</li>
</ul>
<li>Allows ICMP traffic type 3 (all codes)
from your VCN's CIDR IPs and any source port.</li>
<ul>
<li>Makes it easy for your instances to
receive connectivity error messages from other instances within the VCN</li>
</ul>
<li>Allows all outgoing traffic</li>
<ul>
<li>Makes it easy for your instances talk to any Internet IP
address if the cloud network has an Internet Gateway</li>
</ul>
</ul>
</div>
<div>
<br /></div>
<div>
<h3>
Route Table</h3>
</div>
<div>
<br /></div>
When you create a subnet, you may optionally specify a <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingroutetables.htm">route table</a> for the subnet to use. If you don't, the subnet uses the cloud network's default route table. You can <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingVCNs.htm#edit_subnet">change which route table the subnet uses</a> at any time.</div>
<div>
<br /></div>
<div>
Each route table has the following features:<br />
<div>
<ul style="text-align: left;">
<li>Has a set of route rules </li>
<ul>
<li>Which provide
mapping for the traffic from subnets through
gateways (represented by <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">route target</span>) to destinations (represented by <span style="font-family: "courier new" , "courier" , monospace; font-size: x-small;">CIDR blocks</span>) outside the VCN</li>
<li>Route table at a subnet is used only if the destination IP address is not within the VCN's CIDR block</li>
<ul>
<li>No route rules are required in order to enable traffic within the VCN itself</li>
</ul>
<li>Each rule specifies </li>
<ul>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingroutetables.htm?Highlight=Destination%20CIDR%20block" target="_blank">Destination CIDR block</a></li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingroutetables.htm?Highlight=Destination%20CIDR%20block" target="_blank">Route Target</a> (the next hop) for the traffic that matches that CIDR</li>
<ul>
<li>Which can be DRG, IGW, <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/NATgateway.htm" target="_blank">NAT Gateway</a>, <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/servicegateway.htm" target="_blank">Service Gateway</a>, <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/VCNpeering.htm" target="_blank">Local Peering Gateway</a> or <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingIPaddresses.htm" target="_blank">Private IP</a></li>
</ul>
</ul>
</ul>
</ul>
</div>
<div>
For example, to configure your VCN to route all Oracle Service access via <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/servicegateway.htm" target="_blank">Service Gateway</a>, refer to <a href="https://docs.cloud.oracle.com/en-us/iaas/Content/Network/Tasks/servicegateway.htm">Access to Oracle Services via ServiceGateway</a>.</div><div><br />
<div>
<h3>
DHCP Options (DNS)</h3>
</div>
<div>
<br /></div>
When you create a subnet, you may optionally specify choices for DNS name resolution using the subnet's set of <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingDHCP.htm" target="_blank">DHCP options</a>. Domain Name System (DNS) lets computers use hostnames instead of IP addresses to communicate with each other.<sup>[1]</sup><br />
<br />
You can choose the <a href="https://xmlandmore.blogspot.com/2018/12/oracle-cloud-infrastructureoci-dns.html" target="_blank">DNS</a> for each subnet from two options<br />
<ul style="text-align: left;">
<li><b>Internet and VCN Resolver</b> (Default) </li>
<ul>
<li>This is an Oracle-provided option that
includes two parts: </li>
<ul>
<li><b>Internet Resolver</b></li>
<ul>
<li>Lets instances use host names that are publicly published on the
Internet.</li>
<li>The instances do not need to have Internet access by way of either an IGW or
an IPSec VPN DRG. </li>
</ul>
<li><b>VCN Resolver</b></li>
<ul>
<li>Lets instances use host names (which you can assign) to communicate
with other instances in the VCN.</li>
</ul>
</ul>
</ul>
<li><b>Custom Resolver</b></li>
<ul>
<li>Use your own DNS servers. </li>
<ul>
<li>These could be Internet IP
addresses for DNS servers in your VCN, or DNS servers in your on-premises
network, which is connected to your VCN by way of an IPSec VPN</li>
</ul>
</ul>
</ul>
Note that you can't change which set of DHCP options is associated with a subnet after the subnet is created. If you don't want to use the default set, make sure to create your desired set of DHCP options before creating the subnet. However, you can still change the values of these options at your discretion. For more details, see <a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/managingDHCP.htm?Highlight=edit%20dhcp%20options#Importan">Important Notes about Your Instances and DHCP Options</a>.</div>
<div>
<br />
<div class="separator" style="clear: both; text-align: center;"><iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen="" frameborder="0" height="315" src="https://www.youtube.com/embed/lj1pDBhVOxk" title="YouTube video player" width="560"></iframe></div>
<div style="text-align: center;">
<span><b>Video 2. </b>OCI Level 100 - Connectivity (YouTube <a href="https://www.youtube.com/watch?v=lj1pDBhVOxk&t=4s" target="_blank">link</a>)</span></div>
<h3>
References</h3>
<ol>
<li><a href="https://xmlandmore.blogspot.com/2018/12/oracle-cloud-infrastructureoci-dns.html"></a><a href="https://xmlandmore.blogspot.com/2018/12/oracle-cloud-infrastructureoci-dns.html">Oracle Cloud Infrastructure―OCI DNS Service Basics</a></li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/PDF%20Only/NetworkOverviewWhitePaper/networkoverviewwhitepaper.htm?Highlight=edit%20dhcp%20options" target="_blank">Virtual Cloud Network Overview and Deployment Guide</a></li>
<li><a href="https://www.oracle.com/webfolder/technetwork/tutorials/ocis/ocis_fundamental/OC-Infra-Funda_sg.pdf" target="_blank">Oracle Cloud Infrastructure Fundamentals</a></li>
<li><a href="https://cloud.oracle.com/en_US/fastconnect/providers" target="_blank">FastConnect Partners</a></li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/overviewIPsec.htm" target="_blank">IPSec VPN Overview</a></li>
<li><a href="https://docs.cloud.oracle.com/iaas/Content/Network/Tasks/configuringCPE.htm" target="_blank">Configuring Your CPE</a> (OCI)</li>
<li><a href="https://www.cybrary.it/0p3n/oracles-next-generation-cloud-infrastructure/" target="_blank">Oracle’s Next Generation Cloud Infrastructure</a></li>
<ul>
<li><b>Off-box virtualization</b>: storage and network IO virtualization is put out into the network</li>
</ul>
<li><a href="https://cloud.oracle.com/iaas/whitepapers/best-practices-deploying-ha-architecture-oci.pdf" target="_blank">Best Practices for Deploying High Availability Architecture on Oracle Cloud Infrastructure</a> (must read)</li><li><a href="https://docs.oracle.com/en-us/iaas/Content/Network/Concepts/connectivityonprem.htm" target="_blank">Access to Your On-Premises Network</a> (OCI)</li><li><a href="https://github.com/terraform-providers/terraform-provider-oci/blob/255817f83956f1f9a3ab903e11465e8b4dde1957/docs/examples/networking/hybrid_dns/Hybrid-DNS-configuration-using-DNS-VM-in-VCN.md" target="_blank"><span style="background-color: #fcff01; color: #800180;">Hybrid DNS Configuration</span></a> (OCI)</li><ul><li>This document describes the process to <b>enable resolution of DNS names </b>of instances <span style="background-color: #fcff01; color: #800180;">in the VCN from on-premises clients</span> and vice-versa, when the on-premises datacenter is connected with the VCN (<b>through <a href="https://docs.oracle.com/en/solutions/connect-onprem-vpn/index.html" target="_blank">VPN</a> or <a href="https://docs.oracle.com/en-us/iaas/Content/Network/Concepts/fastconnectoverview.htm" target="_blank">FastConnect</a></b>).</li></ul><li><a href="https://xmlandmore.blogspot.com/2018/12/oracle-cloud-infrastructureoci-dns.html" target="_blank">Oracle Cloud Infrastructure―OCI DNS Service Basics</a></li><li><a href="https://xmlandmore.blogspot.com/2019/01/ociknowing-gateway-basics.html" target="_blank">OCI―Knowing Gateway Basics</a></li></ol>
</div>
</div>
</div>
Travel for Lifehttp://www.blogger.com/profile/14903166424561297055noreply@blogger.com0