CTS fail分析
| Test | Status | Detail | Bug | Comments | |
| android.app.cts.DownloadManagerTest | |||||
| -- testDownloadManager | fail | junit.framework.AssertionFailedError: Make sure you have WiFi or some other connectivity for this test. at android.app.cts.DownloadManagerTest$DownloadCompleteReceiver.waitForDownloadComplete(DownloadManagerTest.java:140) | Bug 105916：这个问题是由于cache的权限变更，init.rc中原来的cache是0777，现在的权限是0744。权限设置为744,会导致testDownloadManager 测试不过 权限设置为777, 会导致另外一项测试不过, 修改为默认的770, testDownloadManager这一项也测试不过, 并且会导致FOTA功能无法使用.需要再分析一下. |
DownloadManager是2.3新增的一个系统服务，用来处理长时间运行的HTTP下载，它不与webkit交互，详细请看 http://developer.android.com/reference/android/app/DownloadManager.html |
start --plan CTS -t android.app.cts.DownloadManagerTest#testDownloadManager |
| -- testMinimumDownload | fail | junit.framework.AssertionFailedError: Make sure you have WiFi or some other connectivity for this test. at android.app.cts.DownloadManagerTest$DownloadCompleteReceiver.waitForDownloadComplete(DownloadManagerTest.java:140) | Bug 106196 ：Device implementations MUST have at least 128MB of memory available to the kernel and userspace.这个问题恐怕不只是遇到空间的问题，还有目录/文件权限问题.权限问题是android.app.cts.DownloadManagerTest --testDownloadManager这个case导致的 | start --plan CTS -t android.app.cts.DownloadManagerTest#testMinimumDownload | |
| Compatibility Test Package: CtsContentTestCases | |||||
| Test | Result | Failure Details | |||
| android.content.cts.ContentResolverSyncTestCase | |||||
| -- testRequestSync | fail | junit.framework.AssertionFailedError at android.content.cts.ContentResolverSyncTestCase.addAccountAndVerifyInitSync(ContentResolverSyncTestCase.java:111) | 无 | start --plan CTS -t android.content.cts.ContentResolverSyncTestCase#testRequestSync | |
| -- testCancelSync | fail | junit.framework.AssertionFailedError at android.content.cts.ContentResolverSyncTestCase.addAccountAndVerifyInitSync(ContentResolverSyncTestCase.java:111) | 无 | start --plan CTS -t android.content.cts.ContentResolverSyncTestCase#testCancelSync | |
| android.hardware.cts.CameraTest | Bug 109395 - camera启动超出1500ms。导致全体失败 | ||||
| -- testTakePicture | fail | junit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) | Bug 109395 - camera启动超出1501ms。导致全体失败 | start --plan CTS -t android.hardware.cts.CameraTest#testTakePicture | |
| -- testPreviewCallback | fail | junit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) | Bug 109395 - camera启动超出1502ms。导致全体失败 | start --plan CTS -t android.hardware.cts.CameraTest#testPreviewCallback | |
| -- testSetOneShotPreviewCallback | fail | junit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) | Bug 109395 - camera启动超出1503ms。导致全体失败 | start --plan CTS -t android.hardware.cts.CameraTest#testSetOneShotPreviewCallback | |
| -- testSetPreviewDisplay | fail | junit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) | Bug 109395 - camera启动超出1504ms。导致全体失败 | start --plan CTS -t android.hardware.cts.CameraTest#testSetPreviewDisplay | |
| -- testDisplayOrientation | fail | junit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) | Bug 109395 - camera启动超出1505ms。导致全体失败 | start --plan CTS -t android.hardware.cts.CameraTest#testDisplayOrientation | |
| -- testParameters | fail | junit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) | Bug 109395 - camera启动超出1506ms。导致全体失败 | start --plan CTS -t android.hardware.cts.CameraTest#testParameters | |
| -- testJpegThumbnailSize | fail | junit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) | Bug 109395 - camera启动超出1507ms。导致全体失败 | start --plan CTS -t android.hardware.cts.CameraTest#testJpegThumbnailSize | |
| -- testJpegExif | fail | junit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) | Bug 109395 - camera启动超出1508ms。导致全体失败 | start --plan CTS -t android.hardware.cts.CameraTest#testJpegExif | |
| -- testLockUnlock | fail | junit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) | Bug 109395 - camera启动超出1509ms。导致全体失败 | start --plan CTS -t android.hardware.cts.CameraTest#testLockUnlock | |
| -- testPreviewCallbackWithBuffer | fail | junit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) | Bug 109395 - camera启动超出1510ms。导致全体失败 | start --plan CTS -t android.hardware.cts.CameraTest#testPreviewCallbackWithBuffer | |
| -- testZoom | fail | junit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) | Bug 109395 - camera启动超出1511ms。导致全体失败 | start --plan CTS -t android.hardware.cts.CameraTest#testZoom | |
| -- testFocusDistances | fail | junit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) | Bug 109395 - camera启动超出1512ms。导致全体失败 | start --plan CTS -t android.hardware.cts.CameraTest#testFocusDistances | |
| -- testCancelAutofocus | fail | junit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) | Bug 109395 - camera启动超出1513ms。导致全体失败 | start --plan CTS -t android.hardware.cts.CameraTest#testCancelAutofocus | |
| -- testPreviewPictureSizesCombination | fail | junit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) | Bug 109395 - camera启动超出1514ms。导致全体失败 | start --plan CTS -t android.hardware.cts.CameraTest#testPreviewPictureSizesCombination | |
| -- testPreviewFpsRange | fail | junit.framework.AssertionFailedError: initializeMessageLooper: start timeout at android.hardware.cts.CameraTest.initializeMessageLooper(CameraTest.java:139) | Bug 109395 - camera启动超出1515ms。导致全体失败 | start --plan CTS -t android.hardware.cts.CameraTest#testPreviewFpsRange | |
| Compatibility Test Package: CtsMediaTestCases | |||||
| Test | Result | Failure Details | |||
| android.media.cts.MediaPlayerTest | |||||
| -- testPlayOggStreamRedirect | fail | 无 | start --plan CTS -t android.media.cts.MediaPlayerTest#testPlayOggStreamRedirect | ||
| android.net.cts.ConnectivityManagerTest | |||||
| -- testStartUsingNetworkFeature_enableHipri | fail | junit.framework.AssertionFailedError: Wifi must be configured to connect to an access point for this test. at android.net.cts.ConnectivityManagerTest.connectToWifi(ConnectivityManagerTest.java:261) | 无hipri接入点类型，该测试项无法支持！ 只要在10秒之内连接，就能通过测试。假如超过10秒才连上，那么就会通不过测试。 这完全变成一个测试WIFI性能的问题了。 APOLLO当前连接AP时间较长到底是否是受到HW的制约呢，或者SW WIFI模块存在优化的可能，这个需要WIFI组的专业人士继续跟踪分析了。 |
若wifi没在十秒内连接上一个连接点（是连接上，而不仅仅是打开wifi），就会报错。若wifi以前没有配置过连接点或者10秒内没有连接上，都会出错，测试很多遍都是因为10秒内没有成功连上而出错。 所以，尝试把wifi打开并连接上，这一步就能过去了。但是，又出现了以下问题： android.net.cts.ConnectivityManagerTest#testStartUsingNetworkFeature_enableHipri..........(fail)应该是没找到有效的APN配置。 |
start --plan CTS -t android.net.cts.ConnectivityManagerTest#testStartUsingNetworkFeature_enableHipri |
| Compatibility Test Package: CtsPermission2TestCases | |||||
| Test | Result | Failure Details | |||
| android.permission2.cts.NoReceiveSmsPermissionTest | |||||
| -- testReceiveTextMessage | fail | java.lang.IllegalArgumentException: Invalid destinationAddress at android.telephony.SmsManager.sendTextMessage(SmsManager.java:84) | 无 | start --plan CTS -t android.permission2.cts.NoReceiveSmsPermissionTest#testReceiveTextMessage | |
| android.permission2.cts.NoReceiveGsmSmsPermissionTest | |||||
| -- testReceiveTextMessage | fail | java.lang.IllegalArgumentException: Invalid destinationAddress at android.telephony.SmsManager.sendTextMessage(SmsManager.java:84) | 无 | start --plan CTS -t android.permission2.cts.NoReceiveGsmSmsPermissionTest#testReceiveTextMessage | |
| Compatibility Test Package: CtsPermissionTestCases | |||||
| Test | Result | Failure Details | |||
| android.permission.cts.FileSystemPermissionTest | |||||
| -- testAllFilesInSysAreNotWritable | fail | junit.framework.AssertionFailedError: /sys/sockutils/skutils_seq_ack at android.permission.cts.FileSystemPermissionTest.assertAllFilesInDirAndSubDirAreNotWritable(FileSystemPermissionTest.java:240) | 无 | start --plan CTS -t android.permission.cts.FileSystemPermissionTest#testAllFilesInSysAreNotWritable | |
| Compatibility Test Package: CtsSpeechTestCases | |||||
| Test | Result | Failure Details | |||
| android.speech.tts.cts.TextToSpeechTest | |||||
| -- testSynthesizeToFile | fail | junit.framework.AssertionFailedError at android.speech.tts.cts.TextToSpeechTest.setUp(TextToSpeechTest.java:110) | 无 | start --plan CTS -t android.speech.tts.cts.TextToSpeechTest#testSynthesizeToFile | |
| -- testAndroidTestCaseSetupProperly | fail | junit.framework.AssertionFailedError at android.speech.tts.cts.TextToSpeechTest.setUp(TextToSpeechTest.java:110) | 无 | start --plan CTS -t android.speech.tts.cts.TextToSpeechTest#testAndroidTestCaseSetupProperly | |
| Compatibility Test Package: CtsTelephonyTestCases | |||||
| Test | Result | Failure Details | |||
| android.telephony.cts.TelephonyManagerTest | |||||
| -- testGetNetworkCountryIso | fail | junit.framework.AssertionFailedError: Country code '' did not match [a-z]{2} at android.telephony.cts.TelephonyManagerTest.testGetNetworkCountryIso(TelephonyManagerTest.java:429) | 无 | start --plan CTS -t android.telephony.cts.TelephonyManagerTest#testGetNetworkCountryIso | |
| -- testGetSimCountryIso | fail | junit.framework.AssertionFailedError: Country code '' did not match [a-z]{2} at android.telephony.cts.TelephonyManagerTest.testGetSimCountryIso(TelephonyManagerTest.java:441) | 无 | start --plan CTS -t android.telephony.cts.TelephonyManagerTest#testGetSimCountryIso | |
| android.telephony.cts.SmsManagerTest | |||||
| -- testSendMessages | fail | java.lang.IllegalArgumentException: Invalid destinationAddress at android.telephony.SmsManager.sendTextMessage(SmsManager.java:84) | 无 | start --plan CTS -t android.telephony.cts.SmsManagerTest#testSendMessages | |
| android.telephony.gsm.cts.SmsManagerTest | |||||
| -- testSendMessages | fail | java.lang.IllegalArgumentException: Invalid destinationAddress at android.telephony.SmsManager.sendTextMessage(SmsManager.java:84) | 无 | start --plan CTS -t android.telephony.gsm.cts.SmsManagerTest#testSendMessages | |
| Compatibility Test Package: CtsTextTestCases | |||||
| Test | Result | Failure Details | |||
| android.text.cts.AutoTextTest | |||||
| -- testGet | fail | junit.framework.AssertionFailedError at android.text.cts.AutoTextTest.testGet(AutoTextTest.java:54) | Bug 106219:经log出现mediaserver died的情况：/system/bin/mediaserver <<< 因此造成了接下来的cts test case失败 Bug 106254:机器只有前摄像头被识别出来，因此这里返回null,使得cts测试fail。这个问题不是新硬件的问题，同一个版本烧在DVT1上面也有同样的问题。我们在DVT3上面测试0629user版本是无法通过，但同样用DVT3上面测试0706user版本是可以通过的，之后不知道为什么一直无法通过。 |
0720工程模式应用测试可以正常切换到后camera，cts此两项case可以通过。0720 user模式的版本测试应用上测试切换后camera，弹出崩溃框，无法进入，导致cts此两项case失败。 |
start --plan CTS -t android.text.cts.AutoTextTest#testGet |
| -- testGetSize | fail | junit.framework.AssertionFailedError at android.text.cts.AutoTextTest.testGetSize(AutoTextTest.java:90) | 无 | start --plan CTS -t android.text.cts.AutoTextTest#testGetSize | |
| android.text.format.cts.TimeTest | |||||
| -- testSetToNow0 | fail | junit.framework.AssertionFailedError: expected:<3.4941376E8> but was:<3.49413E8> at android.text.format.cts.TimeTest.testSetToNow0(TimeTest.java:608) | 无 | start --plan CTS -t android.text.format.cts.TimeTest#testSetToNow0 | |
| Compatibility Test Package: android.core.tests.luni.net | |||||
| Test | Result | Failure Details | |||
| org.apache.harmony.luni.tests.java.net.InetAddressTest | |||||
| -- test_getAllByNameLjava_lang_String | fail | java.net.UnknownHostException: www.google.com at java.net.InetAddress.lookupHostByName(InetAddress.java:506) | Bug 103645：该项和103646一样的原因，是对unknow.host地址无法解析，需要通过wifi连接上网（只通过sim卡上网不会pass）。所以建议在cts测试时，插入sim卡，通过wifi联网（需要保证能上网），可通过该项。通过2G 3G上网不能通过。所以在测试时，通过wifi上网 |
这个跟ap的运营商有很大关系，总结出的经验是：在能联网的大前提下，adb shell进去输入ping unknow.host返回“ping unknow host unknow.host”时，该项能通过。由于条件的限制，未能在上海对各种运营商的ap进行测试，目前能总结出的是电信的ap不能通过。 |
start --plan CTS -t org.apache.harmony.luni.tests.java.net.InetAddressTest#test_getAllByNameLjava_lang_String |
| -- test_isReachableLjava_net_NetworkInterfaceII_loopbackInterface | fail | java.net.UnknownHostException: www.google.com at java.net.InetAddress.lookupHostByName(InetAddress.java:497) | 无 | start --plan CTS -t org.apache.harmony.luni.tests.java.net.InetAddressTest#test_isReachableLjava_net_NetworkInterfaceII_loopbackInterface | |
| org.apache.harmony.luni.tests.java.net.URLConnectionTest | |||||
| -- test_getAllowUserInteraction | fail | java.net.UnknownHostException: onearth.jpl.nasa.gov at java.net.InetAddress.lookupHostByName(InetAddress.java:506) | 无 | start --plan CTS -t org.apache.harmony.luni.tests.java.net.URLConnectionTest#test_getAllowUserInteraction | |
| -- test_getDate | fail | junit.framework.AssertionFailedError: getDate gave wrong date: 0 at org.apache.harmony.luni.tests.java.net.URLConnectionTest.test_getDate(URLConnectionTest.java:790) | 无 | start --plan CTS -t org.apache.harmony.luni.tests.java.net.URLConnectionTest#test_getDate | |
| -- test_getExpiration | fail | junit.framework.AssertionFailedError: getExpiration returned wrong expiration: 0 at org.apache.harmony.luni.tests.java.net.URLConnectionTest.test_getExpiration(URLConnectionTest.java:1030) | 无 | start --plan CTS -t org.apache.harmony.luni.tests.java.net.URLConnectionTest#test_getExpiration | |
| -- test_getLastModified | fail | java.net.UnknownHostException: www.php.net at java.net.InetAddress.lookupHostByName(InetAddress.java:506) | 无 | start --plan CTS -t org.apache.harmony.luni.tests.java.net.URLConnectionTest#test_getLastModified | |
| -- test_getOutputStream | fail | java.net.UnknownHostException: www.google.com at java.net.InetAddress.lookupHostByName(InetAddress.java:506) | 无 | start --plan CTS -t org.apache.harmony.luni.tests.java.net.URLConnectionTest#test_getOutputStream | |
| Compatibility Test Package: android.core.tests.luni.util | |||||
| Test | Result | Failure Details | |||
| tests.api.java.util.DateTest | |||||
| -- test_Constructor | fail | junit.framework.AssertionFailedError: Created incorrect date: 908305740000 now: 352704146 at tests.api.java.util.DateTest.test_Constructor(DateTest.java:49) | 无 | start --plan CTS -t tests.api.java.util.DateTest#test_Constructor | |
| Test Timeouts (2) | |||||
| Compatibility Test Package: CtsMediaTestCases | |||||
| Test | Result | Failure Details | |||