Bug 51524 - "Run in Test Cloud" context menu item missing for UITest projects in Solution Explorer
Summary: "Run in Test Cloud" context menu item missing for UITest projects in Solution...
Status: RESOLVED ANSWERED
Alias: None
Product: Visual Studio Extensions
Classification: Xamarin
Component: Test Cloud ()
Version: 4.3.0 (C9)
Hardware: PC Mac OS
: Normal normal
Target Milestone: Future Cycle
Assignee: Bugzilla
URL:
Depends on:
Blocks:
 
Reported: 2017-01-13 21:14 UTC by Cody Beyer (MSFT)
Modified: 2017-08-24 13:55 UTC (History)
16 users (show)

Tags:
Is this bug a regression?: Yes
Last known good build: XamarinVS 4.2.2.11 (00fa5cc)


Attachments
Logs (2.21 KB, application/x-zip-compressed)
2017-03-22 13:35 UTC, Swati Gangrade
Details
Run in test Cloud option is missing in 2017 (111.80 KB, image/png)
2017-03-22 13:37 UTC, Swati Gangrade
Details


Notice (2018-05-24): bugzilla.xamarin.com is now in read-only mode.

Please join us on Visual Studio Developer Community and in the Xamarin and Mono organizations on GitHub to continue tracking issues. Bugzilla will remain available for reference in read-only mode. We will continue to work on open Bugzilla bugs, copy them to the new locations as needed for follow-up, and add the new items under Related Links.

Our sincere thanks to everyone who has contributed on this bug tracker over the years. Thanks also for your understanding as we make these adjustments and improvements for the future.


Please create a new report on Developer Community with your current version information, steps to reproduce, and relevant error messages or log files if you are hitting an issue that looks similar to this resolved bug and you do not yet see a matching new report.

Related Links:
Status:
RESOLVED ANSWERED

Description Cody Beyer (MSFT) 2017-01-13 21:14:53 UTC
# Description

After building a UITest script, the "Submit to Test Cloud"[1] option is not longer present within Visual Studio, using VS 2017

[1]
https://developer.xamarin.com/guides/testcloud/uitest/working-with/submitting-tests-to-xamarin-test-cloud/

# Steps to Reproduce

1. Create an app
2. Add a UITest project
3. Build
4. Right click on UITest

# Expected Results

Submit to Test Cloud should be present

# Actual Results

Submit to Test Cloud is not present

# Versions

Microsoft Visual Studio Enterprise 2017 RC
Version 15.0.26020.0 D15REL
Microsoft .NET Framework
Version 4.6.01586

Installed Version: Enterprise

Architecture Diagrams and Analysis Tools   00369-50000-00000-AA792
Microsoft Architecture Diagrams and Analysis Tools

Visual Basic 2017 RC   00369-50000-00000-AA792
Microsoft Visual Basic 2017 RC

Visual C# 2017 RC   00369-50000-00000-AA792
Microsoft Visual C# 2017 RC

Visual C++ 2017 RC   00369-50000-00000-AA792
Microsoft Visual C++ 2017 RC

Visual F# 4.1   00369-50000-00000-AA792
Microsoft Visual F# 4.1

Application Insights Tools for Visual Studio Package   8.4.01118.2
Application Insights Tools for Visual Studio

ASP.NET and Web Tools 2016   15.0.21206.0
ASP.NET and Web Tools 2016

Command Bus, Event Stream and Async Manager   Merq
Provides ICommandBus, IEventStream and IAsyncManager MEF services for loosely coupled Visual Studio extension components communication and integration.

Common Azure Tools   1.8
Provides common services for use by Azure Mobile Services and Microsoft Azure Tools.

JavaScript Language Service   2.0
JavaScript Language Service

JavaScript Project System   2.0
JavaScript Project System

JavaScript UWP Project System   2.0
JavaScript UWP Project System

Microsoft Visual Studio VC Package   1.0
Microsoft Visual Studio VC Package

Mono Debugging for Visual Studio   Mono.Debugging.VisualStudio
Support for debugging Mono processes with Visual Studio.

NuGet Package Manager   4.0.0
NuGet Package Manager in Visual Studio. For more information about NuGet, visit http://docs.nuget.org/.

TypeScript   2.1.3.0
TypeScript tools for Visual Studio

Visual Studio Tools for Universal Windows Apps   15.0.26009.00
The Visual Studio Tools for Universal Windows apps allow you to build a single universal app experience that can reach every device running Windows 10: phone, tablet, PC, and more. It includes the Microsoft Windows 10 Software Development Kit.

Xamarin   4.3.0.459 (7c3dcf2)
Visual Studio extension to enable development for Xamarin.iOS and Xamarin.Android.

Xamarin.Android   7.1.0.13 (72366f7)
Visual Studio extension to enable development for Xamarin.Android.

Xamarin.iOS   10.4.0.33 (d93ae7e)
Visual Studio extension to enable development for Xamarin.iOS.
Comment 1 vga 2017-01-16 19:01:36 UTC
We will re-add this back ASAP.
Comment 2 xamarin-release-manager 2017-01-16 21:14:37 UTC
Fixed in version 99.1.0.544 (master)

Author: victorgarciaaprea
Commit: 5e2e85d7a518e732b06c54de21273e3aee1b4491 (xamarin/XamarinVS)
Comment 3 Saurabh Paunikar 2017-03-21 09:23:32 UTC
Hi Victor,

Where Can a get version 99.1.0.544 (master) for VS 2017.As per my knowledge we access VS 2017 through VPN
Comment 4 Swati Gangrade 2017-03-22 13:35:36 UTC
Created attachment 20677 [details]
Logs

Bug is verified and retested in below build environment:
 - Microsoft Visual Studio Enterprise 2017 Preview (2)
 - Version 15.1 (26321.1-Preview) d15rel Preview
 - VisualStudio.15.Preview.Int/15.1.0-Preview+26321.1.d15rel
 - Microsoft .NET Framework Version 4.6.01586
 - Xamarin   4.4.0.12 (1878e36)
 - Xamarin.Android SDK   7.2.0.6 (b8e3884)
 - Xamarin.iOS and Xamarin.Mac SDK   10.8.0.26 (0e9e791)
Actual result-As discussed with Ben Beckley on slack Run in Test Cloud phrasing is correct and the fix the for the bug.but for above build configuration, Run in Test Cloud option is not present
Comment 5 Swati Gangrade 2017-03-22 13:37:01 UTC
Created attachment 20678 [details]
Run in test Cloud option is missing in 2017

Pleas refer the attached log and image.Hence Reopening the bug
Comment 6 Brendan Zagaeski (Xamarin Team, assistant) 2017-04-05 02:22:54 UTC
## Regression and verification status: regression in Cycle 9 compared to Cycle 8 SR 2, verified fixed on "15.1" target milestone _except_ in Visual Studio 2017

> BAD:  XamarinVS 4.4.0.33  (80d9a02) "15.1"         in VS 2017 (26401.1-Preview)
> GOOD: XamarinVS 4.4.0.31  (511c8b5) "15.1"         in VS 2015 Update 3
> BAD:  XamarinVS 4.3.0.784 (73f58d6) "Cycle 9"      in VS 2015 Update 3
> GOOD: XamarinVS 4.2.2.11  (00fa5cc) "Cycle 8 SR 2" in VS 2015 Update 3
Comment 7 Curia Damiano 2017-05-11 12:12:55 UTC
Installed VS2017.2, the voice menu is still missing
Comment 8 Curia Damiano 2017-05-11 12:13:48 UTC
Installed VS2017.2, the menu item is still missing
Comment 9 Pierce Boggan [MSFT] 2017-07-07 18:35:44 UTC
Thanks so much for taking the time to submit this report! I can confirm using the latest Visual Studio 15.3 preview builds I am able to reproduce this issue. Marking this report as CONFIRMED.
Comment 11 Balog Gergely 2017-08-02 10:59:55 UTC
Missing for me as well, VS 2017 Enterprise 15.2 
Xamarin 4.5.0486
Xamarin.Android SDK 7.3.1.2
Xamarin.IOS and Xamarin.Mac SDK 10.10.0.37
Comment 12 Pierce Boggan [MSFT] 2017-08-21 17:59:19 UTC
The "Run in Test Cloud" shortcut no longer being included in Visual Studio 2017 is an intended change. The best way to deploy UITests to Test Cloud is via the command line:
https://developer.xamarin.com/guides/testcloud/uitest/working-with/submitting-tests-at-command-line/

We're working on updating our documentation to reflect this for Visual Studio on Windows. Thanks!
Comment 13 Curia Damiano 2017-08-24 13:34:14 UTC
Hi Pierce,
can I ask why this menu item has been removed only from Visual Studio for PC and not for Mac?
Also: as you can see by the number of comments, this issue was really helpful.
Is there an user voice to ask its reintroduction?
Regards, Damiano
Comment 14 Curia Damiano 2017-08-24 13:42:32 UTC
P.S: the documentation refers to the device parameter in this way:
--devices <DEVICE ID>: The device ID that was provided in the Test Cloud Upload dialog.

If there is no UI, how can we calculate this parameter?!?

Regards, Damiano
Comment 15 Tom Opgenorth 2017-08-24 13:47:41 UTC
@Curia: You will need to create a Test Run on the Test Cloud website - https://developer.xamarin.com/guides/testcloud/organizations-and-teams/creating-a-test-run/. This is a wizard that will allow you to select the devices for your test run and then generate a DEVICE_ID parameter based on the devices selected.

Note that you can share the DEVICE_ID between projects/test runs; it s not necessary to create a new DEVICE_ID each time you want to run tests.
Comment 16 Curia Damiano 2017-08-24 13:55:53 UTC
Understood now. Thank you!
But still I miss the Visual Studio menu item :-)