Sunday, February 10, 2013

Implementing Informatica Persistent Cache


You must have noticed that the "time" Informatica takes to build the lookup cache can be too much sometimes depending on the lookup table size/volume. Using Persistent Cache, you may save lot of your time. This article describes how to do it.

What is Persistent Cache?

Lookups are cached by default in Informatica. This means that Informatica by default brings in the entire data of the lookup table from database server to Informatica Server as a part of lookup cache building activity during session run. If the lookup table is too huge, this ought to take quite some time. Now consider this scenario - what if you are looking up to the same table different times using different lookups in different mappings? Do you want to spend the time of building the lookup cache again and again for each lookup? Off course not! Just use persistent cache option!

Yes, Lookup cache can be either non-persistent or persistent. The Integration Service saves or deletes lookup cache files after a successful session run based on whether the Lookup cache is checked as persistent or not.

Where and when we shall use persistent cache:

Suppose we have a lookup table with same lookup condition and return/output ports and the lookup table is used many times in multiple mappings. Let us say a Customer Dimension table is used in many mappings to populate the surrogate key in the fact tables based on their source system keys. Now if we cache the same Customer Dimension table multiple times in multiple mappings that would definitely affect the SLA loading timeline.

There can be some functional reasons also for selecting to use persistent cache. Please read the article Advantage and Disadvantage of Persistent Cache Lookup to know how persistent cache can be used to ensure data integrity in long running ETL sessions where underlying tables are also changing.

So the solution is to use Named Persistent Cache.

In the first mapping we will create the Named Persistent Cache file by setting three properties in the Properties tab of Lookup transformation.
§  Lookup cache persistent:
To be checked i.e. a Named Persistent Cache will be used.
§  Cache File Name Prefix:
user_defined_cache_file_name i.e. the Named Persistent cache file name that will be used in all the other mappings using the same lookup table. Enter the prefix name only. Do not enter .idx or .dat
§  Re-cache from lookup source:
To be checked i.e. the Named Persistent Cache file will be rebuilt or refreshed with the current data of the lookup table.
Next in all the mappings where we want to use the same already built Named Persistent Cache we need to set two properties in the Properties tab of Lookup transformation.
§  Lookup cache persistent:
To be checked i.e. the lookup will be using a Named Persistent Cache that is already saved in Cache Directory and if the cache file is not there the session will not fail it will just create the cache file instead.
§  Cache File Name Prefix:
user_defined_cache_file_name i.e. the Named Persistent cache file name that was defined in the mapping where the persistent cache file was created.



42 comments:

  1. Hi admin, thanks for sharing your informative post on java. Java Training in Chennai

    ReplyDelete
  2. This information is impressive; I am inspired with your post writing style & how continuously you describe this topic. After reading your post, thanks for taking the time to discuss this, I feel happy about it and I love learning more about this topic.
    Regards,
    SAP training in chennai|SAP course in chennai|SAP Training in Chennai|sap training in Chennai

    ReplyDelete
  3. Awesome Post! I like writing style, how you describing the topics throughout the post. I hope many web reader will keep reading your post at the end, Thanks for sharing your view.
    Regards,
    Angularjs training in chennai|Angularjs training chennai|Angularjs course in chennai|Angularjs training center in Chennai

    ReplyDelete
  4. Nice Article, Thanks for sharing with us !!

    Visit - http://tekclasses.in/

    ReplyDelete
  5. Great Post..
    http://www.informaticaonlinetraining.co/

    ReplyDelete
  6. Thanks for splitting your comprehension with us. It’s really useful to me & I hope it helps the people who in need of this vital information.
    Regards,
    PHP Training in Chennai | Best PHP training in Chennai

    ReplyDelete
  7. Implementing Informatica Persistent Cache is a very good topic, Thank you for mentioning this topic in your blog. The way of explanation is extremely awesome. Really it is one of the very good blog for Informatica. Informatica Online Training in Hyderabad Informatica Online Training in USA Informatica Online Training in INDIA

    ReplyDelete
  8. Wonderful bloggers like yourself who would positively reply encouraged me to be more open and engaging in commenting. So know it's helpful..

    Data warehousing Training in Chennai

    ReplyDelete
  9. QuickBooks Payroll has emerged one of the better accounting software that has had changed this is of payroll. Quickbooks Payroll Support contact number will be the team that provide youQuickBooks Payroll Support Phone Number

    ReplyDelete
  10. QuickBooks Enterprise Support Proper analyses are done first. The experts find out of the nature pertaining to trouble. You will definately get a complete knowledge as well. The support specialist will identify the problem.

    ReplyDelete
  11. No matter whether you are getting performance errors or perhaps you are facing any kind of trouble to upgrade your software to its latest version, you are able to quickly get advice about QuickBooks 2018 support phone number. Each time you dial QuickBooks Support Number, your queries get instantly solved. Moreover, you could get in contact with our professional technicians via our email and chat support options for prompt resolution on most related issues.

    ReplyDelete
  12. When this occurs it is actually natural to own a loss in operation. But, I will be at your side. In the event that you hire our service, you are receiving the very best solution. We're going to assure you as a result of the error-free service. QuickBook Support is internationally recognized. You have to started to used to understand this help.

    ReplyDelete
  13. With QuickBooks, you are able to rest assured about getting the most desirable and efficacious help on every issue which you might encounter yourself with. You merely have to avail the assistance from the technical experts by dialing the QuikcBooks Tech Support Number.

    ReplyDelete
  14. Yes, our QuickBooks Enterprise Support Number USA could be a magic bullet to resolve any QuickBooks Enterprise tech issue. Our QuickBooks Enterprise Support team is comprised of QuickBooks Experts who are able to solve your problems instantly the moment they get a call on QuickBooks Enterprise number.

    ReplyDelete
  15. However, in the event that you feel that you urgently need to hire our ProAdvisor to do the work for you, you can dial QuickBooks assisted payroll support telephone number . This will be our QuickBooks Payroll Helpline Number available 24/7 for several users.

    ReplyDelete
  16. QuickBooks Desktop Payroll Support Phone NumberSo so now you are becoming well tuned directly into advantages of QuickBooks online payroll in your business accounting but because this premium software contains advanced functions that will help you and your accounting task to accomplish, so you could face some technical errors when using the QuickBooks payroll solution. In that case, Quickbooks online payroll support number provides 24/7 make it possible to our customer. Only you must do is make a person call at our toll-free QuickBooks Payroll tech support number . You could get resolve most of the major issues include installations problem, data access issue, printing related issue, software setup, server not responding error etc with this QuickBooks payroll support team.

    ReplyDelete
  17. Very often client faces some typically common issues like he/she isn’t ready to open QuickBooks package, QuickBooks Support Phone Number is playing terribly slow, struggling to set up and re-install, a challenge in printing checks or client reports.

    ReplyDelete
  18. A timely resolution into the minimum span is the targets of QuickBooks Support Number Pro-Advisors. The diagnose and issue resolution process has been made step by step and is kept as easy as possible.

    ReplyDelete
  19. Intuit Online QuickBooks Payroll Service Number is the better option for companies looking forward to automating their accounting solutions and take their company to new heights.

    ReplyDelete
  20. In the event your software encounters the matter, you will start feeling the few hiccups in your system like getting booted out from the system often or strange improvement in data. To save some time and money in resolving the situation technically, try not to think twice to offer us a call at Choose QuickBooks Enterprise Support Number.

    ReplyDelete
  21. Earnings: for starters, a business can only survive if it is making adequate profits to smoothly run the operations of the work. Our QuickBooks Support Phone Number team will really show you in helping you discover in regards to the profit projections in QuickBooks.

    ReplyDelete
  22. Take comfort in with a myriad of outshined customer care services for QuickBooks via Support For QuickBooks at any time and from anywhere. It signifies you could access our tech support for QuickBooks at any time.

    ReplyDelete

  23. QuickBooks support phone number get you one-demand technical help for QuickBooks. QuickBooks allows a number of third-party software integration. QuickBooks Support Phone Number software integration is one of the most useful solution provided by the software to handle the accounting tasks in a simpler and precise way.

    ReplyDelete
  24. Where could you turn if you have to deal with the company’s transaction? It must be flawless. Do you think you're confident about it? If you don't, this could be simply the right time so you can get the QuickBooks Tech Support Phone Number

    ReplyDelete
  25. Any QuickBooks user faces any type of identified errors in their daily accounting routine; these errors may differ in one another to a big degree, so our dedicated QuickBooks Tech Support Number are well designed with their tools and expertise to give you most effective resolutions in no time to your customers.

    ReplyDelete
  26. Every user will get 24/7 support services with our online technical experts using QuickBooks Tech Support Number. When you’re stuck in a situation where you can’t find a way to eliminate a concern,

    ReplyDelete
  27. Might you run a company? Would it be too much to deal with all? You need a hand for support. QuickBooks Technical Support Number is a remedy. If you want to accomplish that through QuickBooks, you obtain several advantages. Today, payroll running is currently complex. You might need advanced software. There must be a premier mix solution.

    ReplyDelete
  28. Here we intend to update you the way you'll be able to obtain QuickBooks enterprise support telephone number or simple recommendations for connecting QuickBooks Enterprise Number USA. QuickBooks is financial software that will assist small enterprise, large business along side home users.

    ReplyDelete
  29. If you’re looking for small-business accounting solutions, initial thing experts and happy costumers will recommend you is QuickBooks Support Intuit’s products for construction contractors through the Quickbooks Pro, Simple Start Plus Pack, Quickbooks Premier Contractor, and Quickbooks Enterprise .

    ReplyDelete
  30. From installation error to upgrading error to update issues to even multi-user troubles etc., most of the issues of QuickBooks Payroll Technical Support Number are solved into the easiest manner by our talented team.

    ReplyDelete

  31. QuickBooks Technical Support Number has almost changed this can be of accounting. Nowadays accounting has exploded in order to become everyone’s cup of tea and that’s only become possible because because of the birth of QuickBooks accounting software.

    ReplyDelete
  32. Do you think you're confident about it? If you don't, this could be simply the right time so you can get the QuickBooks Support Phone Number. We now have trained staff to soft your issue.

    ReplyDelete
  33. Dial QuickBooks Tech Support Phone Number 1-855-236-7529 and get effective solutions for QuickBooks Error 6000 308. QuickBooks is popular accounting software that is capable of performing accounting tasks like payroll management and time tracking. The simplicity of this software makes it easy for any user to work on it. Despite being laced with such amazing features, this software sometimes gets entangled with some nasty errors like QuickBooks Error 6000 308. The team at QuickBooks Tech Support Phone Number 1-855-236-7529 provides simple solutions for the resolution of QuickBooks Error 6000 308.
    Read more: https://tinyurl.com/y3kahnzm

    ReplyDelete
  34. QuickBooks desktop enterprise comes with tracking of upto one-million items, vendors and buyers. It has advance and additional features than its two subsidiaries. Desktop enterprise has several advantages with disadvantages in the form of error. To get troubleshooting methods for any error, call us on QuickBooks Enterprise Support Phone Number +1-888-238-7409. Read more: - https://www.enetquickbookenterprise.com/ Visit us:- QuickBooks Error Support Phone Number

    ReplyDelete
  35. Are you still facing problem, while working on QuickBooks Payroll Accounting Software? Have,
    you yet not received, a reliable technical support team? If that’s the case, you have landed on
    the right page. In case, you feel something is wrong with your software. Make an immediate
    call at our QuickBooks Payroll Support Phone Number 1-844-235-3996.Visit us:-https://tinyurl.com/yyyb3ql6

    ReplyDelete
  36. This awesome post of yours should be tagged as the best post of this season. Your amazing post is delight for any readers, so don’t stop here, and keep posting more. QuickBooks POS is one of the enhanced versions of this software that simplifies numerous tasks of your business in a hassle-free manner. As this software too like others are not spared by technical and non-technical errors or bugs. Thus if you encounter any sorts of issue dial our exclusive QuickBooks POS Support Number 1-844-235-3996 and avail the best of solutions to your problem.Visit us:-https://tinyurl.com/y53d8baj

    ReplyDelete
  37. Hey! Great work. I feel so happy to be here reading your post. Do you know QuickBooks Desktop is the leading brand in the accounting world? I have been using this software for the past 3 years. I love the ease of use and the different tools provided by the software. In case you want any help regarding your software then dial QuickBooks Desktop Support Phone Number 1-833-441-8848.

    ReplyDelete
  38. QuickBooks Prominent Features and Excellent QuickBooks Customer Support Phone Number +1 (855)-907-0605 QuickBooks is a world-class accounting software for small and medium sizes business. This accounting software has made the task of business owners quite easy by simplifying the management of accounting and finance

    ReplyDelete
  39. They will not only help you solve your issues regarding QB Errors but will also give you more information about such errors so that the next time you encounter an error, you are able to solve them on your own. Do contact our experts by calling QuickBooks Enterprise Support Phone Number. If you would like to learn How To Troubleshoot QuickBooks Error 9999, you can continue reading this blog.


    ReplyDelete

Thank you :
- kareem