Tuesday, June 9, 2015

Data Flow - Sitecore WebForms For Marketer (WFFM) - Part I

In this Blog post series, I will discuss about the Data Flow of Sitecore 8 - from front-end website to MSSQL Databases


1) Data Flow - Sitecore WebForms For Marketer (WFFM) - Part I
2) Data Flow - Sitecore WebForms For Marketer (WFFM) - Part II


Setting Up :


1) Create WFFM Form


2) Add newly created WFFM form to Item Presentation Details


3) Publish

4) View it in Front Website

5) Empty Forms Reports
As you can see from the below image, WFFM reports does not have any records. So, we will start with a fresh copy of WFFM.




Data Injection :

Enter Data to WFFM form fields and click "Submit"



Data Flow :

1)  Front Webpage to Session

User enters data into wffm form and click "Submit" button
You can view the data going from front webpage to server by using Fiddler tool (see Screenshot below)



2)  Session to MongoDB database

Sitecore migrate data from Session to MongoDB only when user session is ended.
By default session end time will be 30mins. You can adjust that time by adding "timeout" parameter to <forms ... > tag as below

    <authentication> 
        <forms name=".ASPXAUTH" cookieless="UseCookies" timeout="2" />
    </authentication>


  • Empty MongoDB - Before processing any data
As you can see in the below image, there is still no MongoDB collection related WFFM, inside the analytics database




  • After processing WFFM form data to MongoDB
When the data was processed to MongoDB at the end of the user session timout, a new collection (FormData) is created inside the analytics database.

Below image displays how data is stored into MongoDB "FormData" collection




That is it for the first part.

In the next part, we will discuss some issues/bug with WFFM module and fixes, when migrating content from MongoDB to MSSQL "reporting" database as well as how these data is processed into MSSQL database tables.

see you soon!!

9 comments:

  1. Nice data flow presentation. Thanks

    ReplyDelete
  2. Hi,
    I am using Sitecore 8 and made setup of mongo db.When i looked into "Experience Profile" analytic's i am not getting data.Is it mandatory to have "Sitecore IP Geolocation service" setup?

    Thanks

    ReplyDelete
  3. by "i am not getting data" did you mean there are NO records/rows visible in the Experience Profile or there are records and only IP related (location/city/etc) information is not there ?

    If first one is the issue, then you need to rebuild your reporting database. First have a look at the correct answer for the first link thread and then follow the reporting database rebuild in the second link
    https://community.sitecore.net/developers/f/9/t/1028
    https://doc.sitecore.net/Sitecore%20Experience%20Platform/xDB%20configuration/Walkthrough%20Rebuilding%20the%20reporting%20database

    ReplyDelete
  4. Hi,
    No records are visible.
    Thanks

    ReplyDelete
  5. Hi ,
    One more thing is in the first link which you have provided according to that in "Segment" DB data is present and the "deploydate" for all records is"2015-02-23 13:33:53.000".

    Thanks

    ReplyDelete
  6. one more thing you need to remember is, visitor data are written into mongodb after visiting user's session is ended. So, setting the timeout value to lower will make the transfer process quick.
    Other thing is, Experience Profile takes data to be displayed in its list from sitecore_analytics_index index. Reporting database rebuild will rebuild that index
    Please let me know your results

    ReplyDelete
    Replies
    1. Hi,
      I am getting below error in Crawling log file in "CM" and "CD" servers

      3728 10:29:01 WARN Hosting Environment Stop Requested : immediate=False
      3728 10:29:01 WARN [Index=sitecore_analytics_index] Crawling Stopped
      3728 10:29:01 WARN [Index=sitecore_core_index] Crawling Stopped
      3728 10:29:01 WARN [Index=sitecore_master_index] Crawling Stopped
      3728 10:29:01 WARN [Index=sitecore_web_index] Crawling Stopped
      3728 10:29:01 WARN [Index=sitecore_marketing_asset_index_master] Crawling Stopped
      3728 10:29:01 WARN [Index=sitecore_testing_index] Crawling Stopped
      3728 10:29:01 WARN [Index=sitecore_suggested_test_index] Crawling Stopped
      3728 10:29:01 WARN [Index=sitecore_fxm_master_index] Crawling Stopped
      3728 10:29:01 WARN [Index=sitecore_fxm_web_index] Crawling Stopped
      3728 10:29:01 WARN [Index=sitecore_list_index] Crawling Stopped
      3728 10:29:01 WARN [Index=social_messages_master] Crawling Stopped
      3728 10:29:01 WARN [Index=social_messages_web] Crawling Stopped
      3728 10:29:01 WARN [Index=sitecore_analytics_index] Crawling Stopped
      3728 10:29:01 WARN [Index=sitecore_core_index] Crawling Stopped
      3728 10:29:01 WARN [Index=sitecore_master_index] Crawling Stopped
      3728 10:29:01 WARN [Index=sitecore_web_index] Crawling Stopped
      3728 10:29:01 WARN [Index=sitecore_marketing_asset_index_master] Crawling Stopped
      3728 10:29:01 WARN [Index=sitecore_testing_index] Crawling Stopped
      3728 10:29:01 WARN [Index=sitecore_suggested_test_index] Crawling Stopped
      3728 10:29:01 WARN [Index=sitecore_fxm_master_index] Crawling Stopped
      3728 10:29:01 WARN [Index=sitecore_fxm_web_index] Crawling Stopped
      3728 10:29:01 WARN [Index=sitecore_list_index] Crawling Stopped
      3728 10:29:01 WARN [Index=social_messages_master] Crawling Stopped
      3728 10:29:01 WARN [Index=social_messages_web] Crawling Stopped
      3728 10:29:31 WARN Hosting Environment Stop Requested : immediate=True

      Will this issue causes data not showing in "Experience Profile"

      Thanks

      Delete
  7. Hi,
    I have checked my log file on CM server and found below error:-

    10132 10:05:13 WARN Tracker.Current is not initialized
    10132 10:05:13 ERROR SessionEndPipeline failed.
    Exception: System.NullReferenceException
    Message: Object reference not set to an instance of an object.
    Source: Sitecore.Analytics.Automation
    at Sitecore.Analytics.Pipelines.VisitEnd.RunAutomation.RunAutomationX(Database database)
    at (Object , Object[] )
    at Sitecore.Pipelines.CorePipeline.Run(PipelineArgs args)
    at (Object , Object[] )
    at Sitecore.Pipelines.CorePipeline.Run(PipelineArgs args)
    at Sitecore.Web.Application.RaiseSessionEndEvent(HttpApplication context)

    Will this error effects contact data that shows in experience profile ?

    Thanks

    ReplyDelete
  8. Hi,

    I am getting following error in Crawling log file in "CM" and "CD" server's

    3728 10:29:01 WARN Hosting Environment Stop Requested : immediate=False
    3728 10:29:01 WARN [Index=sitecore_analytics_index] Crawling Stopped
    3728 10:29:01 WARN [Index=sitecore_core_index] Crawling Stopped
    3728 10:29:01 WARN [Index=sitecore_master_index] Crawling Stopped
    3728 10:29:01 WARN [Index=sitecore_web_index] Crawling Stopped
    3728 10:29:01 WARN [Index=sitecore_marketing_asset_index_master] Crawling Stopped
    3728 10:29:01 WARN [Index=sitecore_testing_index] Crawling Stopped
    3728 10:29:01 WARN [Index=sitecore_suggested_test_index] Crawling Stopped
    3728 10:29:01 WARN [Index=sitecore_fxm_master_index] Crawling Stopped
    3728 10:29:01 WARN [Index=sitecore_fxm_web_index] Crawling Stopped
    3728 10:29:01 WARN [Index=sitecore_list_index] Crawling Stopped
    3728 10:29:01 WARN [Index=social_messages_master] Crawling Stopped
    3728 10:29:01 WARN [Index=social_messages_web] Crawling Stopped
    3728 10:29:01 WARN [Index=sitecore_analytics_index] Crawling Stopped
    3728 10:29:01 WARN [Index=sitecore_core_index] Crawling Stopped
    3728 10:29:01 WARN [Index=sitecore_master_index] Crawling Stopped
    3728 10:29:01 WARN [Index=sitecore_web_index] Crawling Stopped
    3728 10:29:01 WARN [Index=sitecore_marketing_asset_index_master] Crawling Stopped
    3728 10:29:01 WARN [Index=sitecore_testing_index] Crawling Stopped
    3728 10:29:01 WARN [Index=sitecore_suggested_test_index] Crawling Stopped
    3728 10:29:01 WARN [Index=sitecore_fxm_master_index] Crawling Stopped
    3728 10:29:01 WARN [Index=sitecore_fxm_web_index] Crawling Stopped
    3728 10:29:01 WARN [Index=sitecore_list_index] Crawling Stopped
    3728 10:29:01 WARN [Index=social_messages_master] Crawling Stopped
    3728 10:29:01 WARN [Index=social_messages_web] Crawling Stopped
    3728 10:29:31 WARN Hosting Environment Stop Requested : immediate=True

    Will this issue causes data not showing in "Experience Profile"

    Thanks

    ReplyDelete