Skip to main content

Posts

PowerBi introduction

What is PowerBi As per industry requirement for quick analysis of different components within the organization like marketing strategy updates, new add campaign updates, employees performance, department level performance and KPI metrics, sales graps, profit-loss KPI's and graphs etc Microsoft builds a platform for visualisation of corresponding data and builds those reports in order to meet the demand. The platform named PowerBi helps in building these reports and refreshing it everyday or in real time analytics. The visuals and graphics can be used from the available layout, or even can be developed with codes and attached into the reports. The different version and pricing helps small scale enterprises to large scale enterprises to connect and avail the benefits. The interface is very user friendly, the GUI is easy to use in compared to earlier reporting tools like tableau or SSRS reporting services. If one need to start learning and building reports so must try downloading the ...

Working with Json File Format In Python

 json Format File: json is java script object notation file format, which is very popular and efficient in storing API calls dataset, or web scrapping dataset, saving configuration details as an intermediate file etc. It is widely acceptable across all environments. Working with json format data through Python: SAMPLE DATASET: var = ' [{'data':{'employee':{'name':'xyz','age':25,'gender':'M','address':''}}]' here we can observe the 'var' stores a string which contain a string, if we see string have a dictionary stored in it, which has 'data' as key and value again contains another dictionary have 'name', 'age', 'gender' and 'address' as keys. Here we will try to work with json data: 1) fetch JSON data: import json var = '''[{"data":{"employee":{"name":"xyz","age":25,"gender":"M",...

SQL SERVER STORED PROCEDURE

 What is a Stored Procedure? So, basically stored procedure or SP is a permanent database object, used to meet business requirement like loading and creation of table, validating source dataset, profiling and gathering data statistics, performing auditing, cataloging any server level information etc. To Understand more about stored procedure, lets say, for a business requirement source dataset need to be profiled and statistics need to be found in order to get information about the source data:- CREATE PROC PROC_NAME ( ) AS BEGIN      BEGIN TRY SELECT  COUNT(*) AS TOTAL_ROWS, MAX(COL1) AS MAXIMUM VALUE INTO #TEMP1 FROM      END TRY     BEGIN CATCH     END CATCH END

SLOWLY CHANGING DIMENSION SSIS

  SLOWLY CHANGING DIMENSION, is an SSIS transformation which can solve problems for dimensions whose attributes are changing by the time, and needs updates in future. Normally once the data is loaded into DWH , we need cleaning during the process. For this purpose we can use inbuilt transformation also, i.e. lookup, fuzzy lookup etc. as well as one can make self built logic using SQL queries or may be by using other built in SSIS transformations. In same way to perform SCD logic three pipelines are needed: 1) Do lookup in order to find the new rows from the source. 2) Make logic using timestamp or hash byte values to recognize the updates in any row, based on the matching record values. 3) And for inferred member rows, need to have new pipeline, checking for inferred rows in dimension table, and according get updates from source. Moreover, making separate logics and then simply save the package for future references will be a better option as compared to directly using  SCD....

Error Escalation and it's cure

 Error Escalation In SQL Server: What is Error Escalation? In DBMS, error could stand on multiple levels, let say database storage level(file path missing, change in disk, corrupt files etc), server connectivity error ( wrong instance connection, unauthorised access error, restricted users activity error), table level or data level error( data truncation, mismatch data type, out of storage etc). These are some common error which by default occurs and must be rectified after receiving it. But some database error that are cause by the queries written on the database could be recognised before execution and proper solution can be created in order to get rid of the error in the runtime of query. Let's understand the topic with an example: If say, the dynamic query is written for checking the existence of any object where object name is the user parameter, in such case may be user provide an input with symbols or keyboard characters which can cause the error, so here we will see how err...

Joins Optimization In SQL server

  What are Joins In SQL ? Joins are command used to combine two or more dataset, horizontally. The dataset may have a relationship between them or not, still joins work. If primary key and foreign key relationship exist then the output result is under refrential integrity and ine can rely on final output. Otherwise the final joined output is not reliable. JOINS Optimization: 1) always choose inner and outer join wisely, inner join result less rows then outer joins in most cases, so it also results faster. 2) use of join hint i.e. Merge, Nested or Hash should be used wisely, for coming to an conclusive execution plan. 3) use of index on the column in where clause as well as the column on which joins are performed is again improving performance. 4) writing joins with nolock hint is better approach. 5) updating statistics of the tables, before running joins queries is better approach. These are the some common practices one can used, beyond that SQL profiler Is always a better option ...