Connect SQL Developer 18.3 with Oracle Autonomous Data Warehouse Cloud

November 10, 2018November 11, 2018 ~ easyoradba ~ Leave a comment

Download the client credentials from your Oracle Cloud account for your Autonomous Data Warehouse Instance. Make sure you note down the username (ADMIN) & password, this will be required later during the connection process

1. Open SQL Developer

create new connection > connection type : cloud wallet

Screen Shot 2018-11-11 at 1.16.21 AM

2. Download JCE files from https://www.oracle.com/technetwork/java/javase/downloads/jce8-download-2133166.html
Unzip the files and it will create a folder called “UnlimitedJCEPolicyJDK8” with below files

US_export_policy.jar
local_policy.jar
README.txt

3. Find path of your JDK 8 and the policy folder

On my Mac it was at : /Library/Java/JavaVirtualMachines/jdk1.8.0_152.jdk

The policy folder which contains jce files is in ../Contents/Home/jre/lib/security

cd /Library/Java/JavaVirtualMachines/jdk1.8.0_152.jdk/Contents/Home/jre/lib/security

4. Copy unlimited access jce files to the policy folder in jdk directory on your machine

sudo cp -p *.jar /Library/Java/JavaVirtualMachines/jdk1.8.0_152.jdk/Contents/Home/jre/lib/security

5. Restart SQL Developer and if everything goes well you can see the configuration file, this is the place where you will give the path for the client credentials

Screen Shot 2018-11-11 at 1.15.26 AM

Configuration file : wallet_DB201811102318.zip

Connection Name : Test Autonomous DB Warehouse

Username : ADMIN

Password : ***********

Do a test and if it is a success, you can save the connection. After you connect, you can create tables, Pl/SQL packages as you would do normally in SQL Developer

Screen Shot 2018-11-11 at 1.23.48 AM

Oracle Cloud : Introduction

November 10, 2018 ~ easyoradba ~ Leave a comment

Oracle has been an incumbent to the cloud space having lost a lot of ground to Amazon and Microsoft.But that hasn’t stopped them to go all guns blazing at the cloud market. Playing on it’s strength of offering Enterprise Applications in a heavily crowded SaaS space along with PaaS and IaaS offerings. Oracle has been pushing aggressively to put their Enterprise on-premise customers to the cloud, their initial offering in this space was nothing to talk about. But the game has changed in the last year with the launch of the Autonomous Data warehouse and Transaction processing cloud .

So after months of trial & error I finally decided to get an Oracle Cloud account. I was not to sure about the general availability of Oracle cloud in Australia, but lucky for me it is available for trial in Australia, though the regions it shows available does not include a Australian availability zone

Screen Shot 2018-11-11 at 12.02.01 AM.png

To get an Oracle Cloud trial account (with 400$ AUD free credit for 3o days) all you need is an email address and a credit card. The credit card is not charged but only a hold of 1$ is put on the card and returned after 3-5 business days.

Head over to https://cloud.oracle.com/home to begin your trial

Once you are done with all the formalities it sends you a temporary password to the email address used for registration. Upon first login you are asked to reset the password.

And there you are, the Oracle Cloud Dashboard page

Screen Shot 2018-11-11 at 12.07.10 AM

This is going to be series and in the next few posts i will be looking at creating an autonomous data warehouse and a transaction processing cloud database.

Send Alerts to Slack with Bash Shell Script

October 29, 2018 ~ easyoradba ~ Leave a comment

Slack has quickly become one of the standard messaging apps in the Enterprise. Many a companies use slack for communication amongst team members and IT departments like having slack channels for projects or critical system groups.

slack

Since most of the people who are supposed to take action on a event are in a slack channel it is sometimes better to have notifications send directly to slack for server events.

One of the requirement I had recently was to create server alerts for checking API gateways and if the webservice was found to be down, to send alert to a slack channel.

To create such event based notification to slack, first you need to create an app in slack and then a webhook to expose it to the internet. Once that is done the remaining magic is done in plain old shell scripting

1. Create an APP in Slack

a) Goto https://api.slack.com/slack-apps

b) Create an App

c) Sign-in with your workspace

2. Create the Slack App and a webhook

a) Go to incoming webhooks and Activate incoming webhooks

You can see the sample of your webhook cURLthen

b) Create a channel in your Slack eg : testalerts and assign to step c below

c) Add new Webhook to workspacee Post To : #testalerts

d) Webhook URLS for Your Workspace

curl -X POST -H ‘Content-type: application/json’ –data ‘{“text”:”Hello, World!”}’ https://hooks.slack.com/services/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

3. Test by POST’ing data to your webhook and it should now come in your slack channel

$ curl -X POST -H ‘Content-type: application/json’ –data ‘{“text”:”Hello, World!”}’ https://hooks.slack.com/services/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

4. Write Shell Script to check a Webservice URL and check for HTTP 200 OK in the header

Shell Script

#!/bin/bash
#################################################################
# SHELL SCRIPT TO MONITOR PUBLIC URL AND REST API GATEWAY
# Created By : Shadab Mohammad
# Company : Whitehat Agency, Sydney
# Created Date : 25/10/2018
# Modified Date : 29/10/2018
#
#################################################################
## Check ASIC WebService ##
#################################################################
if curl -s –head –request GET https://abr.business.gov.au | grep “200 OK” > /dev/null; then
echo “https://abr.business.gov.au is UP”
else
echo “https://abr.business.gov.au is DOWN”
curl -X POST -H ‘Content-type: application/json’ –data ‘{“text”:”https://abr.business.gov.au is DOWN”}’ https://hooks.slack.com/services/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
fi

The above shell script checks the header for 200 OK message , if found it sends alert to the channel via the slack webhook. It can be added to crontab to check the status of the webservice every 5 minutes. If the Webservice is down it will send notification to the Slack channel.

IBM buys Redhat in US$34 Billion deal

October 29, 2018October 29, 2018 ~ easyoradba ~ Leave a comment

In one of the largest software M&A ever, IBM has paid US$34 billion in cash to acquire the Enterprise opensource OS company Redhat. The merger was announced few hours before and has come as a shock to many a companies.

This marks a new era in IBM’s cloud push, but what would be interesting is to watch how IBM would treat Redhat’s cash cow Redhat Enterprise Linux. Will it let Redhat run as an independent entity or start tightly coupling it with IBM’s Power cpu architecture.

You can read more on the news in the link below:

https://www.businessinsider.com.au/ibm-is-reportedly-nearing-a-deal-to-acquire-redhat-the-software-company-valued-at-20-billion-2018-10?r=US&IR=T red_hat_logo

Replace duplicate values only in consecutive records with NULL

September 19, 2018 ~ easyoradba ~ Leave a comment

— Replace duplicate values only in consecutive records with NULL [duplicate]–

SELECT
CASE
WHEN lag(tran_id) over(order by NULL) = tran_id
THEN NULL
ELSE tran_id
END tran_id,
CASE
WHEN lag(tran_name) over(order by NULL) = tran_name
THEN NULL
ELSE tran_name
END tran_name,
flag
FROM t;

TRAN_ID TRAN_N F
———- —— –
101 Lend A
B
C
D
102 Borrow E
101 Lend F
G

7 rows selected.

SELECT
CASE
WHEN lag(A.CLIENTID) over(order by NULL) = A.CLIENTID
THEN NULL
ELSE A.CLIENTID
END CLIENTID,
CASE
WHEN lag(A.QUOTEID) over(order by NULL) = A.QUOTEID
THEN NULL
ELSE A.QUOTEID
END QUOTEID,
A.CLIENT_TYPE,
B.FISCAL_YEAR
FROM creditcheck_indv A
LEFT OUTER JOIN CREDIT_FISCAL_YEARS B ON A.CLIENTID=B.CLIENTID

CLIENTID QUOTEID FISCAL_YEAR
——– ——– ————
12345 2222 10/SEP/18
14/SEP/17

ORDS Create Basic Authentication for a RESTful Web Service

September 2, 2018 ~ easyoradba ~ Leave a comment

ORDS Basic Authentication

1. To protect the web service, we need to create a role with an associated privilege, then map the privilege to the web service

BEGIN
ORDS.create_role(
p_role_name => ‘boomi_role’
);

COMMIT;
END;
/

— Display the role.
COLUMN name FORMAT A20

SELECT id, name
FROM user_ords_roles
WHERE name = ‘boomi_role’;

ID NAME
———- ——————–
10063 boomi_role

DECLARE
l_arr OWA.vc_arr;
BEGIN
l_arr(1) := ‘boomi_role’;

ORDS.define_privilege (
p_privilege_name => ‘boomi_priv’,
p_roles => l_arr,
p_label => ‘Vehicle Data’,
p_description => ‘Allow access to the Vehicle data.’
);

COMMIT;
END;
/

— Display the privilege.
COLUMN name FORMAT A20

SELECT id, name
FROM user_ords_privileges
WHERE name = ‘boomi_priv’;

ID NAME
———- ——————–
10064 boomi_priv

— Display the privilege-role relationship.
COLUMN privilege_name FORMAT A20
COLUMN role_name FORMAT A20

SELECT privilege_id, privilege_name, role_id, role_name
FROM user_ords_privilege_roles
WHERE role_name = ‘boomi_role’;

PRIVILEGE_ID PRIVILEGE_NAME ROLE_ID ROLE_NAME
———— ——————– ———- ——————–
10064 boomi_priv 10063 boomi_role

2. To protect the web service, we associate the privilege directly to a URL pattern.
Refer : ORDS Basic Authentication Not Working (Doc ID 2375337.1)
Full REST URL : GET : https://hostname:8443/ords/moov/v1/

BEGIN
ORDS.create_privilege_mapping(
p_privilege_name => ‘boomi_priv’,
p_pattern => ‘/v1/*’
);

COMMIT;
END;
/

— Display mapping.
COLUMN name FORMAT A20
COLUMN pattern FORMAT A20

SELECT privilege_id, name, pattern
FROM user_ords_privilege_mappings
WHERE name = ‘boomi_priv’;

PRIVILEGE_ID NAME PATTERN
———— —————————————–
10064 boomi_priv /v1/*

Once this mapping is in place, we can no longer access the web service without authentication. We haven;t defined how we should authenticate, but only that we need some authentication to access this web service

3. Create a new ORDS user called “boomi_user” with access to the “boomi_role” role.

$ cd $CATALINA_HOME/webapps/ords

$ $JAVA_HOME/bin/java -jar ords.war user boomi_user boomi_role
Enter a password for user boomi_user: *******
Confirm password for user boomi_user: ********
Sep 03, 2018 12:06:34 AM oracle.dbtools.standalone.ModifyUser execute
INFO: Created user: boomi_user in file: /u01/conf/ords/credentials

Now access the web service from a client like POSTMAN or PAW and use basic authentication with username and password which you set earlier

username : boomi_user
password: ******

ORDS 18.2 – The database user for the connection pool named apex_pu, is not authorized to proxy to the schema named

September 2, 2018 ~ easyoradba ~ Leave a comment

ORDS Version : 18.2
Oracle Version : 12cR2

Error : The database user for the connection pool named apex_pu, is not authorized to proxy to the schema named HR

Desc: The error occurs when you have published a RESTful web service from a table inside a schema. When you try to call the Webs service it gives an internal error, because the schema does not have proxy connect privilege to the ORDS public user.

Solution : Grant the username connect through privilege

SQL> alter user HR grant connect through ords_public_user;

Now try calling the REST service again and it should return the valid result set.

Install Oracle 18c(18.3) on CentOS 7.5 Silent Mode

August 12, 2018August 12, 2018 ~ easyoradba ~ Leave a comment

Linux Version : CentOS 7.5
Oracle Version : 18c (18.3.0.0)

1. Download the Zip file from Oracle Website and create groups and oracle user(https://www.oracle.com/technetwork/database/enterprise-edition/downloads/oracle18c-linux-180000-5022980.html ) ##

groupadd oinstall
groupadd dba

useradd oracle -g oinstall -G dba
passwd oracle

Create .bash_profile , in my test server i use 3 different Oracle homes and versions, so the bash profile looks a bit extra funky 😉

# .bash_profile

# Get the aliases and functions
if [ -f ~/.bashrc ]; then
. ~/.bashrc
fi

# User specific environment and startup programs
export CATALINA_HOME=/home/oracle/apache-tomcat
PATH=/bin:/usr/bin:/etc:/usr/sbin:/usr/ucb:$HOME/bin:/usr/bin/X11:/sbin:/bin/bash:$CATALINA_HOME/bin.
export PATH
EDITOR=vi
export EDITOR=vi

if [ -s “$MAIL” ] # This is at Shell startup. In normal
then echo “$MAILMSG” # operation, the Shell checks
fi # periodically.

echo ” ”
echo ” ”
echo ” ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~”
echo ” Database options”
echo ” ”
echo ” ”
echo ” 1) DATABASE 12cR2″
echo ” ”
echo ” 2) DATABASE 12cR1″
echo ” ”
echo ” 3) DATABASE 18.3″
echo ” ”
echo ” ”
echo ” ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~”
echo ” ”
echo ” ”
echo ” Enter Choice:\c”
read env
if [ $env -eq 1 ] ; then
export ORACLE_HOME=/u01/app/oracle/product/12.2.0/dbhome_1
export ORACLE_BASE=/u01/app/oracle
export ORACLE_SID=ora12c
PS1=’$PWD:12cR2–>’

else
if [ $env -eq 2 ] ; then
export ORACLE_HOME=/u01/app/oracle/product/12.1.0/dbhome_1
export ORACLE_BASE=/u01/app/oracle
export ORACLE_SID=moovorix
PS1=’$PWD:12cR1–>’
fi

if [ $env -eq 3 ] ; then
export ORACLE_HOME=/u01/app/oracle/product/18.3.0/dbhome_1
export ORACLE_BASE=/u01/app/oracle
export ORACLE_SID=ora18c
PS1=’$PWD:18c–>’
fi
fi
export LD_LIBRARY_PATH=$ORACLE_HOME/lib:/usr/lib:/lib
export LIBPATH=$ORACLE_HOME/lib32:$ORACLE_HOME/lib:/usr/lib:/lib
export PATH=$PATH:$ORACLE_HOME/bin:/u01/app/12.1.0.2/grid/bin:$ORACLE_HOME/OPatch
stty erase ^?
TMOUT=0;TIMEOUT=600;export readonly TMOUT TIMEOUT
set -o vi

echo ”
echo ”
clear
echo
echo “ORACLE_SID=$ORACLE_SID”
echo

alias tsmd=’cd /opt/tivoli/tsm/client/oracle/bin64/’
alias ob=’cd $ORACLE_BASE’
alias oh=’cd $ORACLE_HOME’
alias tns=’cd $ORACLE_HOME/network/admin’
alias ch=’cd $CATALINA_HOME’
alias envo=’env | grep ORACLE’
alias sqld=’rlwrap sqlplus “/as sysdba”‘
alias cpu=”cat /proc/cpuinfo | awk ‘/^processor/{print $3}’ | wc -l”
alias py=’/usr/bin/python3.6′
alias py2=’/usr/bin/python’
export PATH
umask 022

envo

2. Install all the pre-requisites, if your on Oracle Linux there is an RPM you can install : oracle-database-preinstall-18c

Else if you prefer do the pre-requisites manually (Which I do)

Check for missing packages

rpm -q –qf ‘%{NAME}-%{VERSION}-%{RELEASE}(%{ARCH})\n’ binutils \
compat-libcap1 \
compat-libstdc++-33 \
elfutils-libelf \
elfutils-libelf-devel \
gcc \
gcc-c++ \
glibc \
glibc-common \
glibc-devel \
glibc-headers \
ksh \
libaio \
libaio-devel \
libgcc \
libstdc++ \
libstdc++-devel \
make \
libXext \
libXtst \
libX11 \
libXau \
libxcb \
libXi \
sysstat \
unixODBC \
unixODBC-devel

Install missing packages with Yum
eg:
rpm -Uvh compat-libcap1

Update Kernel Parameters

Open sysctl.conf file and add the kernel parameters

vi /etc/sysctl.conf

fs.file-max = 6815744
kernel.sem = 250 32000 100 128
kernel.shmmni = 4096
kernel.shmall = 1073741824
kernel.shmmax = 4398046511104
net.core.rmem_default = 262144
net.core.rmem_max = 4194304
net.core.wmem_default = 262144
net.core.wmem_max = 1048576
fs.aio-max-nr = 1048576
net.ipv4.ip_local_port_range = 9000 65500

Add Limits for Oracle user

Open file limits.conf and add below parameters

vi /etc/security/limits.conf

–shell limits for users oracle 18c

oracle soft nofile 1024
oracle hard nofile 65536
oracle soft nproc 2047
oracle hard nproc 16384
oracle soft stack 10240
oracle hard stack 32768

3. Silent Installation of 18c Software, the new installer is a zipped Oracle Home which you need to unzip to your Oracle Home directory and installation command just relinks all libraries. The installation is super quick due to this, afer this installation you are never going back to the normal runInstaller again

mkdir -p /u01/app/oracle/product/18.3.0/dbhome_1/

unzip -q LINUX.X64_180000_db_home.zip -d /u01/app/oracle/product/18.3.0/dbhome_1/

cd /u01/app/oracle/product/18.3.0/dbhome_1/

sed -e ‘/\s*#.*$/d’ -e ‘/^\s*$/d’ install/response/db_install.rsp > install/response/db_18c.rsp

cat install/response/db_18c.rsp
## Remove all other parameters and just leave the below ##

oracle.install.responseFileVersion=/oracle/install/rspfmt_dbinstall_response_schema_v18.0.0
oracle.install.option=INSTALL_DB_SWONLY
UNIX_GROUP_NAME=oinstall
INVENTORY_LOCATION=/u01/app/oraInventory
ORACLE_HOME=/u01/app/oracle/product/18.3.0/dbhome_1
ORACLE_BASE=/u01/app/oracle
oracle.install.db.InstallEdition=EE
oracle.install.db.OSDBA_GROUP=dba
oracle.install.db.OSOPER_GROUP=dba
oracle.install.db.OSBACKUPDBA_GROUP=dba
oracle.install.db.OSDGDBA_GROUP=dba
oracle.install.db.OSKMDBA_GROUP=dba
oracle.install.db.OSRACDBA_GROUP=dba

## If an error “[WARNING] [INS-13001] Oracle Database is not supported on this operating system 18c” pops up; the use parameter ignoreInternalDriverError in the runinstaller ##

./runInstaller -silent -responseFile install/response/db_18c.rsp -ignoreInternalDriverError

## As Root User ##
sh /u01/app/oracle/product/18.3.0/dbhome_1/root.sh

4. Silent Creation of Database using dbca silent mode

dbca -createDatabase -silent -gdbName ora18c -templateName General_Purpose.dbc -sysPassword sys123 -systemPassword sys123 -dbsnmpPassword sys123 -datafileDestination /u01/oradata -storageType FS -memoryPercentage 20 -emConfiguration NONE -sampleSchema false

[FATAL] [DBT-50000] Unable to check for available memory.
[FATAL] [DBT-50001] Unable to check the value of kernel parameter {0}

While creating a on-premise 18c (18.3) database with DBCA in the silent mode If you get above error. Then use the parameter -J-Doracle.assistants.dbca.validate.ConfigurationParams=false ; it can be used both in cli and gui ##

5. Create Listener for 18c

cd /u01/app/oracle/product/18.3.0/dbhome_1/admin/network

vi listener.ora

SID_LIST_LISTENER_18C =
(SID_LIST =
(SID_DESC =
(GLOBAL_DBNAME = ora18c)
(ORACLE_HOME = /u01/app/oracle/product/18.3.0/dbhome_1)
(SID_NAME = ora18c)
)
)

LISTENER_18C =
(DESCRIPTION_LIST =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = 103.42.111.196)(PORT = 1523))
)
)

lsnrctl start LISTENER_18C

Checking from SQL*PLUS

SQL*Plus: Release 18.0.0.0.0 – Production on Mon Aug 13 04:03:10 2018
Version 18.3.0.0.0

Connected to:
Oracle Database 18c Enterprise Edition Release 18.0.0.0.0 – Production
Version 18.3.0.0.0

SQL> select name,open_mode from v$database;

NAME OPEN_MODE
——— ——————–
ORA18C READ WRITE

Dkam7GRUwAA3XXJ.jpg large

Oracle 18c (18.3) DBCA Issue – [DBT-50000] [DBT-50001]

August 12, 2018August 12, 2018 ~ easyoradba ~ Leave a comment

While creating a on-premise 18c (18.3) database with DBCA in the silent mode I got the below error

dbca -createDatabase -silent -gdbName ora18c -templateName General_Purpose.dbc -sysPassword sys123 -systemPassword sys123 -dbsnmpPassword sys123 -datafileDestination /u01/oradata -storageType FS -memoryPercentage 20 -emConfiguration NONE -sampleSchema false

[FATAL] [DBT-50000] Unable to check for available memory.
[FATAL] [DBT-50001] Unable to check the value of kernel parameter {0}

I am not too sure what exactly causes that error but i am suspecting their is something in the kernel parameters which is not right for the 18c installation, especially since i did not install the 18c per-requisites RPM and my Linux is CentOS 7.5

The Solution to this problem is to call dbca with below parameter, it can be used for CLI and GUI both.

-J-Doracle.assistants.dbca.validate.ConfigurationParams=false

Full DBCA command

Prepare for db operation
10% complete
Copying database files
40% complete
Creating and starting Oracle instance
42% complete
46% complete
50% complete
54% complete
60% complete
Completing Database Creation
66% complete
69% complete
70% complete
Executing Post Configuration Actions
100% complete
Database creation complete. For details check the logfiles at:
/u01/app/oracle/cfgtoollogs/dbca/ora18c.
Database Information:
Global Database Name:ora18c
System Identifier(SID):ora18c
Look at the log file “/u01/app/oracle/cfgtoollogs/dbca/ora18c/ora18c.log” for further details.

It will give some warnings but it is due to not using a strong password. But it should not have caused at any issues in creating the database. Lets check with SQLPLUS

SQL*Plus: Release 18.0.0.0.0 – Production on Mon Aug 13 03:13:45 2018
Version 18.3.0.0.0

Connected to:
Oracle Database 18c Enterprise Edition Release 18.0.0.0.0 – Production
Version 18.3.0.0.0

SQL> select name,open_mode from v$database;

NAME OPEN_MODE
——— ——————–
ORA18C READ WRITE

SCP and Pass Variable in Bash Script

August 7, 2018 ~ easyoradba ~ Leave a comment

#!/bin/bash


read -p 'Enter the Files to be Send to Remote Host: ' files

destination_directory='/home/oracle'
scp -i /Users/shadab/wha.pem $files oracle@192.168.1.200:$destination_directory

## SAMPLE USAGE ## # shadabs-MacBook-Pro:~ shadab$ ./scp_files.sh #Enter the Files to be Send to Remote Host: *.sh #scp_files.sh 100% 344 39.1KB/s 00:00 #scp_files_gone.sh 100% 344 52.3KB/s 00:00 # # #shadabs-MacBook-Pro:~ shadab$ ./scp_files.sh #Enter the Files to be Send to Remote Host: scp_files.sh #scp_files.sh 100% 434 80.5KB/s 00:00

You can now add alias for this script in .bashrpc file

alias scpo=’sh /Users/shadab/scp_files.sh’

EasyOraDBA

Oracle Database | Exadata | Oracle Cloud | Analytics | Big Data

Send Alerts to Slack with Bash Shell Script

Like this:

IBM buys Redhat in US$34 Billion deal

Like this:

Replace duplicate values only in consecutive records with NULL

Like this:

ORDS Create Basic Authentication for a RESTful Web Service

Like this:

ORDS 18.2 – The database user for the connection pool named apex_pu, is not authorized to proxy to the schema named

Like this:

Install Oracle 18c(18.3) on CentOS 7.5 Silent Mode

Like this:

Oracle 18c (18.3) DBCA Issue – [DBT-50000] [DBT-50001]

Like this:

SCP and Pass Variable in Bash Script

Like this:

Share :

Like this:

Share :

Like this:

Share :

Like this:

Share :

Like this:

Share :

Like this:

Share :

Like this:

Share :

Like this:

Share :

Like this:

Share :

Like this:

Share :

Like this: