Share via


Project Server: Refresh calculated fields for all projects via PowerShell PSI calls

https://msdnshared.blob.core.windows.net/media/2016/05/0640_NinjaAwardTinyGold.pngGold Award Winner


 

Introduction and problem 

Microsoft Project Portfolio Management (PPM) platform - Project Server is pretty well known for its confusing behaviour both for developers and IT specialists (worth to mention even some official documents: Product documentation "Developers working with the Project Server Interface (PSI) can be confused by this behaviour", The Bat phone: white paper).  

One of the numerous difficulties is with calculated fields refresh. While PWA (Project Web Access) calculated fields and indicators are rather convenient for end-user as a self-service BI (Business Intelligence) elements implementation it needs special efforts in some cases in order to get the values up to date. 

PowerShell solution reduces the number of assets to be managed if compared to .NET assembly implementation but requires translation C#/VB PSI (Project Server Interface) documentation calls into corresponding PowerShell code.  
 
Below is an approach considered which updates, saves and publishes all the projects in order to force a Project Server custom fields recalculation via PowerShell. 

Solution 

Solution scheme is pretty straightforward but contains some Project Server-specific elements that can be depicted as follows: 

Code 

 

#t-sql launch

#xp_cmdshell 'powershell.exe -ExecutionPolicy bypass -Command "& {& ''\T005\Exchange\publishprojects.ps1''}"'

 

function AddDeletePublish($descr) 

$ProjDataSet.Clear();

$projectTasks = $ProjDataSet.Task;

 

#add task

       write-host -ForegroundColor green "$((New-TimeSpan $t $(Get-Date)).TotalSeconds) sec";$t = get-date;

   Write-Host -ForegroundColor green ("QueueAddToProject $descr ...");

      $NewTaskGuid = [System.Guid]::NewGuid()

      $NewTaskRow1 = $projectTasks.NewTaskRow();

         $NewTaskRow1.PROJ_UID = $projectUid;

         $NewTaskRow1.TASK_UID = $NewTaskGuid

         $NewTaskRow1.TASK_DUR_FMT = 53;

         $NewTaskRow1.TASK_DUR = 4800;  

         $NewTaskRow1.TASK_NAME = "temp task";

         $NewTaskRow1.TASK_START_DATE = [datetime]::Now;

      $projectTasks.AddTaskRow($NewTaskRow1);

 

 $NewJobGuid = [system.guid]::NewGuid()

# Add the above dataset to project and publish and check in

$svcPSProxy.QueueAddToProject($NewJobGuid, $SessionGuid, $ProjDataSet, $false);

        

       sleep 1

       WaitForJob($NewJobGuid);

 

    # publish project

       write-host -ForegroundColor green "$((New-TimeSpan $t $(Get-Date)).TotalSeconds) sec";$t = get-date;

    Write-Host -ForegroundColor green ("QueuePublish $descr ...");

    $NewJobGuid = [system.guid]::NewGuid()

    $temp = $svcPSProxy.QueuePublish($NewJobGuid, $projectUid, $true,"");

       WaitForJob($NewJobGuid);

};

 

function PublishWithCFupdates($pwaUrl,[System.Guid]$puid) 

{

#http://social.msdn.microsoft.com/Forums/en-US/5c9dc24a-62d3-4ce4-a575-4abf918da610/how-to-create-task-in-pwa-with-powershell?forum=project2010custprog

cls

$t = get-date

write-host -ForegroundColor  green "$((New-TimeSpan $t $(Get-Date)).TotalSeconds) sec";$t = get-date;

write-host -ForegroundColor  green "connecting to services.."

$PSvcUrl = $pwaUrl + "/_vti_bin/PSI/Project.asmx?wsdl" 

$svcPSProxy = New-WebServiceProxy -uri $PSvcUrl -useDefaultCredential;

 

#Queue web service 

$QSvcUrl = $pwaUrl + "/_vti_bin/PSI/QueueSystem.asmx?wsdl" 

$QSvcProxy = New-WebServiceProxy -uri $QSvcUrl -useDefaultCredential; #-credential $Credential

 

write-host -ForegroundColor  green "$((New-TimeSpan $t $(Get-Date)).TotalSeconds) sec";$t = get-date;

Write-Host -ForegroundColor green ("read projects");

 

$EPMTYGUID = [system.guid]::empty

$ProjectList = $svcPSProxy.ReadProjectStatus("$EPMTYGUID","WorkingStore","", "0").Project | format-table proj_uid -hidetableheaders | out-string -stream

if($puid){$projectList = @($puid)}

 

$projects_left_to_process =  $ProjectList.Count;

 

foreach ($projectUid in $ProjectList)

{

      

       Write-Host -ForegroundColor green ("projects to process left $projects_left_to_process");

 

       $projects_left_to_process = $projects_left_to_process - 1;

    if ($projectUid -eq ""){continue;}

       Write-Host -ForegroundColor green ("processing project $projectUid");

 

       $projectUid=[System.Guid]$projectUid;

       $SessionGuid = [System.Guid]::NewGuid() ;

    $SessionDescr = "refresh calculations" ;

   

       write-host -ForegroundColor green "$((New-TimeSpan $t $(Get-Date)).TotalSeconds) sec";$t = get-date;

       Write-Host -ForegroundColor green ("force checkin project...");

       $NewJobGuid = [system.guid]::NewGuid();

    $temp = $svcPSProxy.QueueCheckInProject($NewJobGuid, $projectUid, $true, $SessionGuid, $SessionDescr);

       sleep 1

       WaitForJob($NewJobGuid); 

      

 

       $G = [System.Guid]::NewGuid() 

 

    $temp = $svcPSProxy.CheckOutProject($projectUid, $SessionGuid, $SessionDescr);

       sleep 1

      

       write-host -ForegroundColor green "$((New-TimeSpan $t $(Get-Date)).TotalSeconds) sec";$t = get-date;

       Write-Host -ForegroundColor green ("ReadProject...");

 

       $ProjDataSet = $svcPSProxy.ReadProjectEntities($projectUid,2,0);

      

       AddDeletePublish("1");

       AddDeletePublish("2");

       write-host -ForegroundColor green "$((New-TimeSpan $t $(Get-Date)).TotalSeconds) sec";$t = get-date;

       Write-Host -ForegroundColor green ("ReadProject...");

 

       $ProjDataSet = $svcPSProxy.ReadProjectEntities($projectUid,2,0);

       $tr = @();

       foreach($task in $ProjDataSet.Task)

       {

         if($task.TASK_NAME -eq "temp task")

              {

                    $tr+=$task.TASK_UID;

             };

       };

      

       write-host -ForegroundColor green "$((New-TimeSpan $t $(Get-Date)).TotalSeconds) sec";$t = get-date;

       Write-Host -ForegroundColor green ("QueueDeleteFromProject $descr ...");

 

       $NewJobGuid = [system.guid]::NewGuid()

       $svcPSProxy.QueueDeleteFromProject($NewJobGuid, $SessionGuid, $projectUid,$tr);

       sleep 1

       WaitForJob($NewJobGuid);

 

       # publish project

       write-host -ForegroundColor green "$((New-TimeSpan $t $(Get-Date)).TotalSeconds) sec";$t = get-date;

    Write-Host -ForegroundColor green ("QueuePublish after del ...");

    $NewJobGuid = [system.guid]::NewGuid()

    $temp = $svcPSProxy.QueuePublish($NewJobGuid, $projectUid, $true,"");

       WaitForJob($NewJobGuid);

 

 

    # check in project

    sleep 1

       write-host -ForegroundColor green "$((New-TimeSpan $t $(Get-Date)).TotalSeconds) sec";$t = get-date;

       Write-Host -ForegroundColor green ("QueueCheckInProject ...");

 

    $NewJobGuid = [system.guid]::NewGuid()

    $temp = $svcPSProxy.QueueCheckInProject($NewJobGuid, $projectUid, $false, $SessionGuid, $SessionDescr);

       WaitForJob($NewJobGuid);

}

write-host -ForegroundColor green "$((New-TimeSpan $t $(Get-Date)).TotalSeconds) sec";$t = get-date;

Write-Host -ForegroundColor green ("done. thank you." );

}

  

function WaitForJob([System.Guid]$jobId)

{

    $QUEUE_WAIT_TIME = 2; # two seconds

    $jobDone = $false;

    $xmlError = [string]::Empty;

    $wait = 0;

 

    # Wait for the project to get through the queue.

    # Get the estimated wait time in seconds.

    # $wait = $QSvcProxy.GetJobWaitTime($jobId);

 

    # Wait for it.

    sleep $wait;

    # Wait until it is finished. 

    do

    {

        # Get the job state.

        $jobState = $QSvcProxy.GetJobCompletionState($jobId,[ref]$xmlError);

             Write-Host -ForegroundColor green ("job state: $jobState");

        if ($jobState -eq "Success")

        {

            $jobDone = $true;

        }

        else

        {

            if (($jobState -eq "Unknown") -or ($jobState -eq "Failed")-or ($jobState -eq "FailedNotBlocking")-or ($jobState -eq "CorrelationBlocked")-or ($jobState -eq "Canceled"))

            {

                # If the job failed, error out.

                Write-Host -ForegroundColor red ("failed");

                           break;

                           # Console.WriteLine("Queue request failed \" + jobState + "\ Job ID: " + jobId + ".");

                # throw new Exception("Queue request failed \" + jobState + "\ Job ID: " + jobId + ".");

            }

            else

            {

                #Console.WriteLine("Job State: " + jobState + " Job ID: " + jobId);

                           $cvt = $QUEUE_WAIT_TIME;

                           Write-Host -ForegroundColor green ("waiting $cvt ..." );

                sleep $cvt ;

            }

        }

    }

    while ($jobDone -eq $false);  

}

 

PublishWithCFupdates "http://project.contoso.com/pwa" $args[0]

#PublishWithCFupdates("http://project.contoso.com/pwa")

Restrictions and Usage 

  • The script needs to be tested carefully in pre-production or at least development environment in order to reveal system peculiarities under long-continued load. 

  • Solution was checked and deployed on Project Server 2010, for Project Server 2013 the scheme seems to be the same. 

  • Solutions can be modified for parallel projects processing with corresponding increased load and additional careful testing. 

  • Number of Add-Publish cycles can be increased/reduced in order to comply to corresponding specific custom fields calculation structures. 

Resources 

Product documentation 

Application Lifecycle Management in SharePoint 2010 

What's new for IT pros in Project Server 2013 

Task Start and Finish Dates 
 

Community 
 
How to create task in PWA with Powershell 

See Also 

SSAS, SSIS: Extending Project Server OLAP Cubes via push-mode processing